-- Logs begin at Fri 2021-10-29 12:54:48 UTC, end at Fri 2021-10-29 13:48:53 UTC. -- Oct 29 13:24:01.052767 dv-cinder-815884-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 13:24:01.062139 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 13:24:01 2021] *** Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: nodename: dv-cinder-815884-1-iscsi Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: machine: x86_64 Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: clock source: unix Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: pcre jit disabled Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: detected number of CPU cores: 4 Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: current working directory: / Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: detected binary path: /usr/bin/uwsgi-core Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: your processes number limit is 47680 Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: your memory page size is 4096 bytes Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: detected max file descriptor number: 2048 Oct 29 13:24:01.064201 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: lock engine: pthread robust mutexes Oct 29 13:24:01.065091 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: thunder lock: enabled Oct 29 13:24:01.065091 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 13:24:01.065091 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 13:24:01.108157 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: Python main interpreter initialized at 0x564e5ffbb9c0 Oct 29 13:24:01.108157 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: python threads support enabled Oct 29 13:24:01.108157 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: your server socket listen backlog is limited to 100 connections Oct 29 13:24:01.108157 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: your mercy for graceful operations on workers is 90 seconds Oct 29 13:24:01.108468 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 13:24:01.108543 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: *** Operational MODE: preforking *** Oct 29 13:24:01.108804 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: *** uWSGI is running in multiple interpreter mode *** Oct 29 13:24:01.108804 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: spawned uWSGI master process (pid: 100581) Oct 29 13:24:01.108979 dv-cinder-815884-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 29 13:24:01.110310 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: spawned uWSGI worker 1 (pid: 100582, cores: 1) Oct 29 13:24:01.110310 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: spawned uWSGI worker 2 (pid: 100583, cores: 1) Oct 29 13:24:01.110310 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 13:24:02.747642 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:24:02.747642 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: from cryptography.utils import int_from_bytes Oct 29 13:24:02.748309 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:24:02.748309 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: from cryptography.utils import int_from_bytes Oct 29 13:24:02.751708 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:24:02.751708 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: from cryptography.utils import int_from_bytes Oct 29 13:24:02.752190 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:24:02.752190 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: from cryptography.utils import int_from_bytes Oct 29 13:24:05.426343 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 13:24:05.426857 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 13:24:05.426956 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 13:24:05.427314 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 13:24:05.427569 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 13:24:05.427891 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 13:24:05.428250 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.428334 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 13:24:05.428424 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.428569 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.428657 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 13:24:05.428890 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.428980 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 13:24:05.429194 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 13:24:05.429280 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.429511 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.429607 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.429865 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.429955 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.430190 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.430304 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.430515 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.430615 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.430775 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.430862 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.431087 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.431181 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.431408 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815884-1-iscsi {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.431496 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.431729 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.431815 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.432034 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.432133 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.432357 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.432448 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.432671 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.432756 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.432974 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.433068 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815884-1-iscsi {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.433294 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.433387 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.433597 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.433690 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.433940 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.434122 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.434257 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.435261 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.435408 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.435528 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.435665 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.435793 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.435916 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436046 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436169 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436294 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436429 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436561 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436702 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436828 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.436958 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.437091 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.437220 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.437332 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.437459 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.437588 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.437717 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.437885 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815884-1-iscsi {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438019 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438143 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438265 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438385 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438515 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438629 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438749 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.438971 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.439100 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815884-1-iscsi {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.439280 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.439407 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.439590 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.439723 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.439912 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.440055 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.440239 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.440409 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.440562 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.440725 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.440861 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.441040 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.441169 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.441365 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.441500 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.441690 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.442030 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.442174 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.442347 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.442488 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.442655 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.442783 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.442965 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.443102 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.443285 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.443421 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.443588 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.443725 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.443892 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.444034 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.444311 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.444443 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.444575 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.444705 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.444835 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.444958 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.445094 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.445221 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.445344 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.445466 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.445592 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.445715 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.445873 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.446002 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.446151 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.446282 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.446472 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.446618 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.446780 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.446915 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.447048 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.447173 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.447358 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.447495 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.447668 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.447794 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.448491 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.448802 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.448937 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.449107 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.449241 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.449412 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.449540 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.449728 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.449935 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.450068 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.450190 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.450396 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.450532 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.450666 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.450798 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.450970 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.451097 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.451292 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.451426 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.451594 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.451730 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.451901 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.452028 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.452219 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.452352 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.452542 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.452670 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.452846 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.452973 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.453165 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.453292 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.453475 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.453602 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.453794 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.453924 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.454105 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.454248 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.454448 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.454577 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.454702 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.454824 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455026 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455161 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455328 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455456 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455580 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455703 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455860 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.455997 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.456162 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.456296 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.456479 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.456614 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.456784 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.456920 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.457088 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.457222 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.457392 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.457519 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.457689 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.457851 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.458024 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.458151 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.458328 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.458463 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.458634 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.458771 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.458943 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.459069 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.459244 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.459370 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.459544 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.459683 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.459848 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.459976 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.460147 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.460282 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.460514 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.460659 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.460816 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.460949 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.461074 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.461203 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.461339 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.461463 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.461631 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.461758 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.461963 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.462092 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.462266 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.462395 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.462582 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.462710 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.462885 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.463019 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.463188 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.463323 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.463493 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.464239 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.464452 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.464586 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.464722 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.464855 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.464975 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.465098 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.465244 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.465382 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.465548 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.465677 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.465882 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.466011 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.466181 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.466308 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.466487 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.466622 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.466794 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.466920 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.467097 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.467239 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.467399 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.467527 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.467699 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.467827 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.467998 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.468138 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.468299 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.468427 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.468600 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.468727 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.468904 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.469038 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.469201 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.469336 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.469498 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.469625 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.469817 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.469966 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.470141 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.470268 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.470447 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.470599 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.470791 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.470932 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.471057 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.471186 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.471344 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.471474 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.471673 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.471807 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.471978 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.472105 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.472288 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.472415 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.472595 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.472724 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.472916 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:24:05.473043 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.473252 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.473379 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.473566 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.473693 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.473902 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.474031 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.474218 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.474359 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.474545 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.474674 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.474856 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.474983 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.475166 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.475303 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.475476 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.475612 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.475792 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.475926 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.476107 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.476245 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.476425 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.476550 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.476737 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.476864 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.477049 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.477175 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.477364 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.477505 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.477674 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.477833 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.478012 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.478149 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.478336 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.478454 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.478656 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.478786 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.478972 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.479107 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.479313 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.479440 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.479634 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.479762 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.479964 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.480098 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.480285 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.480411 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.480598 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.480723 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.480938 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.481066 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.481218 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.481359 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.481530 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.481668 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.481859 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.481989 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.482170 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.482298 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.482481 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.482609 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.482795 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.482923 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.483132 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.483259 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.483445 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.483582 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.483764 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.483890 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.484067 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.484194 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.484371 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.484508 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.484675 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.484803 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.484985 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.485114 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.485288 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.485427 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.485609 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.485736 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.485943 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.486070 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.486251 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.486391 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.486562 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.486695 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.486871 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.486999 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.487178 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.487312 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.487486 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.487620 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.487789 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.487919 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.488100 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.488230 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.488410 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.488537 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.488715 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.488851 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.489028 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.489155 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.489341 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.489469 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.489650 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.489844 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.489986 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.490118 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.490281 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.490411 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.490587 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.490725 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.490974 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.491120 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.491245 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.491374 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.491505 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.491637 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.491813 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.491941 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.492117 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.492243 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.492435 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.492572 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.492745 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.492890 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.493058 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.493183 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.493371 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.493509 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.493975 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.494114 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.494289 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.494416 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.494623 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.494757 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.494946 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.495079 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.495255 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.495383 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.495565 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.495694 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.495869 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.495998 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.496173 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.496301 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.496480 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.496610 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.496789 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.496916 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.497093 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.497229 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.497399 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.497525 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.497701 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.497867 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.498029 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.498171 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.498334 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.498472 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.498638 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.498774 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.498948 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.499084 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.499254 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.499388 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.499557 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.499684 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.499858 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.499995 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.500182 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.500315 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.500495 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.500622 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.500802 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.500940 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.501145 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.501280 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.501405 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.501536 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.501743 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.501893 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.502089 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.502216 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.502404 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.502532 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.502715 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.502844 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.503026 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.503161 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.503337 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.503465 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.503647 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.503783 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.503967 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.504100 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.504276 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.504411 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.504592 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.504719 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.504901 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.505035 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.505214 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.505339 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.505522 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.505649 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.505863 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.506003 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.506167 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.506304 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.506479 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.506607 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.506804 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.506931 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.507120 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.507257 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.507444 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.507572 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.507751 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.507877 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.508065 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.508201 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.508380 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.508507 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.508689 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.508818 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.509005 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.509141 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.509316 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.509445 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.509626 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.509754 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.509971 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.510107 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.510283 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.510412 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.511110 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.511256 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.511457 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.511585 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.511731 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.511857 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.512040 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.512173 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.512359 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.512487 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.512661 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.512787 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.512975 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.513102 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.513301 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.513437 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.513616 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.513744 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.513959 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.514098 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.514265 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.514392 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.514582 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.514711 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.514891 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.515023 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.515201 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.515332 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.515510 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.515638 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.515872 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.516055 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.516185 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.516365 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.516502 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.516676 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.516805 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.516994 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.517122 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.517303 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.517432 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.517613 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.517740 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.517940 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.518080 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.518254 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.518381 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.518564 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.518705 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.518870 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.518998 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.519173 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.519302 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.519485 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.519622 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.519799 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.519926 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.520106 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.520232 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.520411 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.520546 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.520725 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.520855 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.521028 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.521154 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.521331 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.521565 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.521696 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.521860 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.521989 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.522119 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.522252 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.522384 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.522550 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.522679 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.522854 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.522983 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.523193 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.523322 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.523502 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.523628 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.523807 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.523934 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.524136 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.524264 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.524429 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.524556 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.524738 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.524867 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.525044 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.525172 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.525378 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.525516 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.525661 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.525826 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.525998 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.526674 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.526850 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.526977 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.527162 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.527301 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.527474 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.527602 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.527784 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.527912 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.528096 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.528233 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.528407 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.528536 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.528731 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.528860 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.529041 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.529182 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.529357 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.529485 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.529666 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.529834 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.529997 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.530127 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.530307 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.530442 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.530621 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.530755 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.530938 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.531182 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.531318 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.531516 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.531723 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.531858 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.531992 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.532138 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.532400 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.532529 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.532736 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.532864 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.533054 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.533191 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.533377 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.533514 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.533690 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.533927 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.534064 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.534189 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.534340 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.534468 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.534647 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.534783 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.534952 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.535081 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.535260 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.535390 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.535564 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.535693 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.535871 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.535998 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.536174 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.536308 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.536482 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.536620 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.536785 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.536920 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.537088 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.537217 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.537391 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.537519 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.537691 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.537880 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.538022 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.538153 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.538316 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.538444 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.538625 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.538760 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.538928 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.539068 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.539246 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.539376 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.539558 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.539695 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.539858 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.539992 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.540161 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.540289 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.540463 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.540592 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.540782 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.540909 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.541090 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.541218 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.541396 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.541525 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.541786 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.541937 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.542106 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.542243 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.542411 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.542538 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.542750 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.542967 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.543095 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.543299 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.543435 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.543606 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.543741 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.543910 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.544045 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.544215 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.544344 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.544522 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.544650 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.544832 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.544960 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.545134 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.545263 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.545442 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.545570 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.545750 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.545912 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.546085 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.546221 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.546390 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.546518 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.546693 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.546821 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.547000 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.547137 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.547302 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.547430 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.547606 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.547741 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.547910 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.548038 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.548212 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.548341 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.548512 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.548715 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.548842 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.548979 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.549105 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.549231 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.549403 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.549541 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.549709 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.549878 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.550038 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.550169 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.550341 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.550476 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.550645 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.550763 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.550947 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.551074 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.551251 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.551380 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.551555 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.551690 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.551862 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.551980 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.552165 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.552264 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.552478 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.552574 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.552784 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.552879 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.553085 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.553180 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.553394 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.553488 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.553697 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.553825 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.554026 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.554120 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.554332 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.554425 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.554635 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.554727 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.554942 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.555034 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.555247 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.555349 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.555556 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.555650 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.555860 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.555952 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.556162 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.556249 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.556465 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.556558 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.556769 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.556860 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.557068 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.557153 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.557392 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.557485 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.557698 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.557805 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.558022 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.558110 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.558323 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.558416 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.558627 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.558710 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.558931 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.559016 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.559235 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.559378 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.559540 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.559670 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.559840 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.559969 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.560152 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.560287 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.560461 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.560591 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.560767 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.560924 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.561107 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.561234 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.561411 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.561538 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.561727 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.561892 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.562096 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.562224 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.562349 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.562471 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.562659 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.562801 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.562961 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.563104 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.563264 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.563387 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.563572 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.563713 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.563884 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.564018 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.564187 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.564348 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.564487 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.564659 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.564788 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.564911 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.565092 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.565224 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.565403 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.565554 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.565721 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.565874 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.566064 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.566191 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.566402 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.566542 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.566675 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.566798 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.566975 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.567103 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.567287 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.567415 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.567595 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.567722 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.567905 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.568034 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.568213 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.568342 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.568523 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.568650 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.568833 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.568966 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.569141 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.569275 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.569454 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.569583 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.569761 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.569957 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.570085 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.570226 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.570378 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.570506 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.570684 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.570821 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.570989 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.571117 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.571301 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.571429 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.571606 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.571741 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.571908 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.572036 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.572250 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.572386 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.572512 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.572646 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.572796 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.573443 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.573623 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.573752 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.573978 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.574106 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.574294 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.574423 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.574601 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.574738 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.574956 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.575092 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.575267 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.575395 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.575576 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.575704 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.575890 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.576019 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.576205 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.576334 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.576509 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.576637 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.576838 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.576966 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.577160 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.577295 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.577471 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.577679 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.577829 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.577955 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.578126 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.578265 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.578430 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.578567 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.578740 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.578877 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.579064 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.579192 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.579370 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.579503 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.579676 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.579805 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.579987 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.580116 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.580310 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.580449 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.580614 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.580742 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.580910 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.581025 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.581233 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.581361 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.581543 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.581673 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.581893 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.582024 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.582316 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.582455 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.582629 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.582758 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.582935 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.583061 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.583260 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.583389 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.583582 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.583718 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.583906 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.584047 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.584212 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.584346 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.584526 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.584656 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.584832 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.584969 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.585155 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.585290 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.585478 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.585605 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.585822 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.585967 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.586124 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.586251 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.586429 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.586557 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.586753 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.586891 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.587069 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.587204 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.587379 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.587507 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.587699 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.587835 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.588025 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.588155 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.588346 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.588473 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.589228 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.589362 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.589586 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.589712 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.589937 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.590077 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.590244 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.590380 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.590554 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.590683 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.590866 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.590996 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.591173 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.591301 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.591478 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.591607 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.591800 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.591928 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.592105 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.592241 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.592456 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.592591 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.592716 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.592839 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.593011 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.593141 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.593317 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.593447 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.593620 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.593748 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.593957 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.594099 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.594261 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.594388 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.594566 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.594693 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.594884 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.595020 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.595191 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.595317 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.595513 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.595640 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.595817 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.595953 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.596139 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.596268 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.596448 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.596576 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.596752 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.596889 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.597054 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.597182 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.597356 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.597492 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.597667 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.597818 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.598002 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.598180 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.598324 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.598458 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.598640 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.598768 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.598945 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.599071 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.599263 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.599403 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.599593 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.599713 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.599923 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.600057 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.600235 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.600370 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.600551 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.600686 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.600877 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.601006 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.601183 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.601379 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.601505 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.601630 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.601810 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.601942 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.602111 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.602253 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.602417 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.602560 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.602751 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.602887 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.603013 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.603147 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.603309 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.603439 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.603614 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.603751 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.603917 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.604054 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.604245 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.604375 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.604559 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.604689 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.604868 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.605005 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.605180 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.605308 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.605486 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.605612 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.605802 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.605927 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.606112 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.606241 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.606429 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.606557 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.606739 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.606870 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.607047 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.607176 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.607375 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.607515 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.607690 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.607819 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.608016 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.608142 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.608325 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.608462 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.608649 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.608779 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.608967 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.609097 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.609279 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.609414 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.609592 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.609720 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.609944 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.610072 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.610257 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.610397 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.610575 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.610706 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.610889 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.611018 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.611197 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.611339 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.611511 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.611640 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.611826 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.611955 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.612140 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.612267 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.612462 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.612649 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.612789 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.612979 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.613117 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.613279 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.613591 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.613719 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.613928 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.614059 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.614242 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.614372 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.614553 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.614689 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.614865 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.615004 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.615177 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.615306 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.615486 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.615614 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.615794 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.615948 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.616110 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.616237 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.616405 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.616542 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.616720 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.616863 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.617054 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.617190 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.617366 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.617494 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.617668 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.617823 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.618003 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.618133 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.618317 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.618446 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.618906 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.619035 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.619228 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.619358 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.619535 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.619672 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.619875 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.620006 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.620194 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.620323 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.620512 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.620653 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.620825 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.620953 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.621136 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.621263 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.621448 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.621613 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.621762 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.621937 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.622093 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.622221 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.622403 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.622541 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.622716 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.622844 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.623029 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.623152 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.623337 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.623462 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.623674 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.623918 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.624017 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.624239 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.624345 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.624570 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.624665 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.624895 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.624987 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.625220 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.625410 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.625541 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.625720 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.625872 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.626078 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.626221 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.626404 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.626698 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.626829 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.627016 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.627145 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.627333 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.627461 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.627659 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.627788 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.627965 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.628094 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.628269 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.628399 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.628579 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.628710 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.628886 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.629023 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.629190 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.629320 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.629501 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.629628 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.629835 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.629982 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.630139 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.630268 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.630461 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.630598 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.630772 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.630911 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.631123 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.631301 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.631431 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.631643 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.631785 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.631956 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.632085 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.632283 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.632564 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.632692 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.632893 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.633022 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.633210 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.633314 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.633536 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.633631 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.633869 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.633967 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.634176 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.634283 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.634492 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.634587 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.634804 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.634899 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.635110 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.635203 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.635891 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.635997 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.636232 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.636377 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.636542 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.636671 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.636847 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.636985 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.637153 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.637316 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.637445 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.637569 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.637797 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.637943 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.638096 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.638224 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.638403 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.638531 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.638707 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.638843 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.639016 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.639151 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.639320 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.639450 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.639625 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.639753 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.639925 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.640052 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.640232 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.640362 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.640543 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.640671 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.640845 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.640973 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.641150 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.641296 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.641451 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.641580 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.641762 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.641913 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.642081 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.642207 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.642383 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.642513 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.642686 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.642813 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.643001 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.643130 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.643308 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.643418 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.643613 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.643715 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.643916 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.644177 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.644272 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.644494 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.644589 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.644818 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.644914 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.645130 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.645224 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.645440 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.645535 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.645763 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.645883 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.646099 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.646186 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.646417 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.646632 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.646769 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.646967 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.647088 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.647302 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.647627 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.647721 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.647969 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.648064 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.648277 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.648362 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.648587 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.648673 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.648894 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.648998 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.649218 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.649303 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.649547 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.649729 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.649894 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.650036 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.650172 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.650297 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.650464 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.650593 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.650774 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.650913 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.651104 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.651714 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.651927 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.652059 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.652274 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.652412 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.652590 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.652727 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.652908 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.653038 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.653346 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.653553 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.653692 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.653852 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.653979 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.654116 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.654295 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.654445 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.654606 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.654733 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.654917 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.655054 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.655228 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.655355 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.655537 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.655664 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.655852 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.655989 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.656183 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.656312 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.656494 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.656621 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.656795 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.656931 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.657136 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.657262 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.657454 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.657588 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.657766 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.657911 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.658150 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.658277 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.658459 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.658617 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.658782 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.658917 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.659104 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.659233 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.659418 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.659545 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.659740 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.659869 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.660052 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.660180 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.660370 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.660506 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.660696 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.660824 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.661010 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.661141 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.661341 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.661478 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.661650 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.661803 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.661982 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.662111 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.662288 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.662431 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.662598 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.662750 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.662927 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.663060 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.663260 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.663409 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.663551 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.663742 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.663878 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.664003 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.664138 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.664263 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.664449 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.664557 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.664770 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.664884 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.665092 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.665194 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.665405 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.665540 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.665712 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.665928 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.666087 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.666172 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.666363 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.666449 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.666673 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.667311 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.667515 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.667602 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.667825 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.667911 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.668134 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.668233 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.668444 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.668530 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.668755 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.668847 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.669067 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.669161 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.669369 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.669454 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.669693 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.669800 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.670034 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.670122 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.670344 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.670443 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.670657 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.670750 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.670966 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.671052 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.671285 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.671369 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.671593 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.671684 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.671980 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.672085 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.672209 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.672305 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.672517 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.672612 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.672833 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.672919 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.673146 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.673231 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.673461 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.673557 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.673802 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.673893 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.674123 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.674210 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.674445 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.674542 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.674772 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.674856 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.675094 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.675186 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.675421 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.675515 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.675751 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.675842 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.675994 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 13:24:05.676095 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.676449 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.676737 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:24:05.676983 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=100582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 13:24:05.698530 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_db.sqlalchemy.engines [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:05.699615 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_db.sqlalchemy.engines [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:05.872502 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.context [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0fd04116-658c-4f9b-9b80-4c1c1d069e0f(cell1) {{(pid=100583) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 13:24:05.872736 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.context [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0fd04116-658c-4f9b-9b80-4c1c1d069e0f(cell1) {{(pid=100582) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 13:24:05.876808 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_concurrency.lockutils [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:24:05.876964 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:24:05.878495 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_concurrency.lockutils [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:24:05.878653 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:24:05.879322 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_concurrency.lockutils [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:24:05.879467 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:24:05.881305 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_concurrency.lockutils [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100582) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:24:05.881461 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:24:05.892597 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_db.sqlalchemy.engines [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:05.895228 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_db.sqlalchemy.engines [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:05.897602 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_db.sqlalchemy.engines [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:05.902607 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_db.sqlalchemy.engines [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:06.160281 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_db.sqlalchemy.engines [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:06.162994 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG oslo_db.sqlalchemy.engines [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=100582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:24:06.506265 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: WARNING keystonemiddleware.auth_token [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:24:06.512768 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: WARNING keystonemiddleware.auth_token [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:24:06.514107 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: WARNING keystonemiddleware.auth_token [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:24:06.520842 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: WARNING keystonemiddleware.auth_token [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:24:06.871319 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: WARNING keystonemiddleware.auth_token [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:24:06.876512 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: WARNING keystonemiddleware.auth_token [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:24:06.876620 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: WARNING keystonemiddleware.auth_token [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:24:06.881711 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: WARNING keystonemiddleware.auth_token [None req-14e40235-9384-4037-9c64-0f5c050bf36c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:24:06.882648 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e5ffbb9c0 pid: 100582 (default app) Oct 29 13:24:06.884740 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:24:06.886468 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] 10.222.0.96 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002291 Oct 29 13:24:06.886879 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 1/1] 10.222.0.96 () {50 vars in 788 bytes} [Fri Oct 29 13:24:06 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:24:06.888323 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e5ffbb9c0 pid: 100583 (default app) Oct 29 13:25:26.420504 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:26.421507 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 29 13:25:26.422111 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 2/2] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:26.839019 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-a62dc67a-8fe3-427b-8fda-3fd2ad8c109d admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:26.868039 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-a62dc67a-8fe3-427b-8fda-3fd2ad8c109d admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.438807 Oct 29 13:25:26.868700 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 1/3] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Oct 29 13:25:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:25:29.099548 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:29.100583 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-7bdb0327-9b90-42b6-86c8-4318e558327a None None] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 29 13:25:29.101136 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 3/4] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:29.161250 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-8135579b-fbf2-4d45-a0e8-808ee2e6a72f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:29.180006 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:25:29.180006 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: warnings.warn(msg) Oct 29 13:25:29.222406 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-8135579b-fbf2-4d45-a0e8-808ee2e6a72f admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.114238 Oct 29 13:25:29.223624 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 2/5] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:29 2021] POST /compute/v2.1/flavors => generated 407 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:29.451319 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-b2d6a034-b29e-4ea4-8726-99bf336b1742 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:29.453698 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:25:29.453698 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: warnings.warn(msg) Oct 29 13:25:29.503432 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-b2d6a034-b29e-4ea4-8726-99bf336b1742 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.271280 Oct 29 13:25:29.504230 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 4/6] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Oct 29 13:25:29 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:25:31.719669 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-8135579b-fbf2-4d45-a0e8-808ee2e6a72f admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:31.720674 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-8135579b-fbf2-4d45-a0e8-808ee2e6a72f admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 29 13:25:31.721071 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 3/7] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:31 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:31.831227 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-237e5a5e-3496-4375-ba35-2224593acfa8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "vcpus": 1, "name": "ds512M"}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:31.848797 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:25:31.848797 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: warnings.warn(msg) Oct 29 13:25:31.869301 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-237e5a5e-3496-4375-ba35-2224593acfa8 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140952 Oct 29 13:25:31.870012 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 5/8] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:31 2021] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:31.883404 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-0d166830-755d-48e7-990e-e08c2157d3e1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:31.886096 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:25:31.886096 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: warnings.warn(msg) Oct 29 13:25:31.925529 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-0d166830-755d-48e7-990e-e08c2157d3e1 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046216 Oct 29 13:25:31.926326 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 4/9] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Oct 29 13:25:31 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:25:34.157632 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-237e5a5e-3496-4375-ba35-2224593acfa8 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:34.158674 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-237e5a5e-3496-4375-ba35-2224593acfa8 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 29 13:25:34.159080 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 6/10] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:34.231334 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-6d71d251-7d28-4513-ab62-58b2e1477abe admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "vcpus": 1, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:34.251467 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-6d71d251-7d28-4513-ab62-58b2e1477abe admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.084215 Oct 29 13:25:34.260287 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 5/11] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:34 2021] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:25:34.265137 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-891345c2-cfd4-4bb2-af7e-90018745292b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:34.288822 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-891345c2-cfd4-4bb2-af7e-90018745292b admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027016 Oct 29 13:25:34.297916 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 7/12] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Oct 29 13:25:34 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:25:36.523522 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-6d71d251-7d28-4513-ab62-58b2e1477abe admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:36.524618 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-6d71d251-7d28-4513-ab62-58b2e1477abe admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Oct 29 13:25:36.524865 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 6/13] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:36 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:36.582948 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-cf092f80-7114-4b87-92d1-b4449e5a5d17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:36.603122 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-cf092f80-7114-4b87-92d1-b4449e5a5d17 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071075 Oct 29 13:25:36.603290 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 8/14] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:36 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:36.624813 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-4bebf811-f536-4248-a9cf-a02954b98169 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:36.653797 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-4bebf811-f536-4248-a9cf-a02954b98169 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040872 Oct 29 13:25:36.654387 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 7/15] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Oct 29 13:25:36 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:25:38.874862 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-cf092f80-7114-4b87-92d1-b4449e5a5d17 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:38.875860 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-cf092f80-7114-4b87-92d1-b4449e5a5d17 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 29 13:25:38.876255 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 9/16] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:38.936355 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-399b3aee-4756-4727-a48c-c3c52f3de8ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 20}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:38.957903 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-399b3aee-4756-4727-a48c-c3c52f3de8ac admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075383 Oct 29 13:25:38.959165 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 8/17] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:38.971241 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-197037cf-5689-4c27-8129-947fbe46a890 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:38.995974 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-197037cf-5689-4c27-8129-947fbe46a890 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028409 Oct 29 13:25:38.997169 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 10/18] 10.222.0.96 () {64 vars in 1335 bytes} [Fri Oct 29 13:25:38 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:25:41.242459 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-399b3aee-4756-4727-a48c-c3c52f3de8ac admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:41.243468 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-399b3aee-4756-4727-a48c-c3c52f3de8ac admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 29 13:25:41.243873 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 9/19] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:41.303491 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-bbda1177-54ed-4ca7-bcb0-74a48d99a8cc admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:41.325746 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-bbda1177-54ed-4ca7-bcb0-74a48d99a8cc admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.074805 Oct 29 13:25:41.326841 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 11/20] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Oct 29 13:25:41 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:25:43.673135 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-399b3aee-4756-4727-a48c-c3c52f3de8ac admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:43.674747 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-399b3aee-4756-4727-a48c-c3c52f3de8ac admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002083 Oct 29 13:25:43.675169 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 10/21] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:43.738732 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-a8d8a51b-2b6c-4824-a3cc-ffcc5f273662 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "ram": 512, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:43.760029 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-a8d8a51b-2b6c-4824-a3cc-ffcc5f273662 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078209 Oct 29 13:25:43.760583 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 12/22] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:43 2021] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:43.775712 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-2ac986ab-71a8-4563-9f6c-1cb42201be88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:43.798223 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-2ac986ab-71a8-4563-9f6c-1cb42201be88 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026814 Oct 29 13:25:43.798826 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 11/23] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Oct 29 13:25:43 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:25:46.072062 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-a8d8a51b-2b6c-4824-a3cc-ffcc5f273662 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:46.073396 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-a8d8a51b-2b6c-4824-a3cc-ffcc5f273662 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001887 Oct 29 13:25:46.074137 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 13/24] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:46.133316 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-39d5c76b-0b62-40f3-be59-31968581895c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "id": "2", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "m1.small"}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:46.151536 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-39d5c76b-0b62-40f3-be59-31968581895c admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071118 Oct 29 13:25:46.152091 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 12/25] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:46.165009 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-7d1545c8-6ccc-4048-b661-ca62894c8c77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:46.187134 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-7d1545c8-6ccc-4048-b661-ca62894c8c77 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026297 Oct 29 13:25:46.187674 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 14/26] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Oct 29 13:25:46 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:25:48.407607 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-39d5c76b-0b62-40f3-be59-31968581895c admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:48.408605 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-39d5c76b-0b62-40f3-be59-31968581895c admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Oct 29 13:25:48.409010 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 13/27] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:48.473757 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-96b6647f-6ace-4023-92e7-d324ffaedc46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:48.493517 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-96b6647f-6ace-4023-92e7-d324ffaedc46 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077529 Oct 29 13:25:48.494434 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 15/28] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:48 2021] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:48.506760 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-b879ad34-dbb3-4d06-ac15-45d8c95915d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:48.529155 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-b879ad34-dbb3-4d06-ac15-45d8c95915d2 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026012 Oct 29 13:25:48.529717 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 14/29] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Oct 29 13:25:48 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:25:50.745797 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-96b6647f-6ace-4023-92e7-d324ffaedc46 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:50.746865 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-96b6647f-6ace-4023-92e7-d324ffaedc46 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 29 13:25:50.747267 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 16/30] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:50.808639 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-4d766b7e-94d2-4d50-96bb-1e8e4dbe335d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "os-flavor-access:is_public": true, "id": "4", "vcpus": 4, "swap": 0, "disk": 80, "ram": 8192}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:50.825960 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-4d766b7e-94d2-4d50-96bb-1e8e4dbe335d admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072182 Oct 29 13:25:50.826816 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 15/31] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:25:50.841238 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-eaef4e6d-5402-4cbd-9a2b-e60e7658607a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:50.863672 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-eaef4e6d-5402-4cbd-9a2b-e60e7658607a admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025947 Oct 29 13:25:50.864360 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 17/32] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Oct 29 13:25:50 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:25:53.093946 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-4d766b7e-94d2-4d50-96bb-1e8e4dbe335d admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:25:53.094961 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-4d766b7e-94d2-4d50-96bb-1e8e4dbe335d admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 29 13:25:53.095529 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 16/33] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:25:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:25:53.156732 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-276951b4-967e-42d9-8558-df7c72ada4e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:53.185218 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-276951b4-967e-42d9-8558-df7c72ada4e1 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083382 Oct 29 13:25:53.185862 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 18/34] 10.222.0.96 () {64 vars in 1282 bytes} [Fri Oct 29 13:25:53 2021] POST /compute/v2.1/flavors => generated 408 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:25:53.198853 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-01f20af3-8c3d-4bd8-93aa-c2b298c0078d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:25:53.228602 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-01f20af3-8c3d-4bd8-93aa-c2b298c0078d admin admin] 10.222.0.96 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034002 Oct 29 13:25:53.229589 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 17/35] 10.222.0.96 () {64 vars in 1332 bytes} [Fri Oct 29 13:25:53 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:26:32.040726 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-276951b4-967e-42d9-8558-df7c72ada4e1 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:32.041737 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-276951b4-967e-42d9-8558-df7c72ada4e1 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Oct 29 13:26:32.042161 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 19/36] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:26:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:32.099451 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-afc255dd-c9f7-4497-89c0-3407ee217150 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:32.116288 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-afc255dd-c9f7-4497-89c0-3407ee217150 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067570 Oct 29 13:26:32.116941 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 18/37] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Oct 29 13:26:32 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:26:33.542544 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-276951b4-967e-42d9-8558-df7c72ada4e1 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:33.543529 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-276951b4-967e-42d9-8558-df7c72ada4e1 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 29 13:26:33.543919 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 20/38] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:33.730196 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-e5db21fd-dad7-48e0-a20e-36eb87c9abbd admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:33.735470 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.wsgi [None req-e5db21fd-dad7-48e0-a20e-36eb87c9abbd admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 13:26:33.736030 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-e5db21fd-dad7-48e0-a20e-36eb87c9abbd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:26:33.736817 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-e5db21fd-dad7-48e0-a20e-36eb87c9abbd admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057113 Oct 29 13:26:33.737317 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 19/39] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Oct 29 13:26:33 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 13:26:33.747669 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-0d0d15ad-5500-466d-b1d6-53e500107ff0 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:33.768032 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-0d0d15ad-5500-466d-b1d6-53e500107ff0 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024120 Oct 29 13:26:33.768551 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 21/40] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Oct 29 13:26:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:26:33.778373 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-40e3b67c-8846-4c2f-b5a4-62e2debcb12e admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:33.798730 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-40e3b67c-8846-4c2f-b5a4-62e2debcb12e admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023770 Oct 29 13:26:33.799250 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 20/41] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Oct 29 13:26:33 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:26:33.809174 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-f6a81417-05f3-4393-8d75-1cfe3e1c144c admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:33.814301 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.wsgi [None req-f6a81417-05f3-4393-8d75-1cfe3e1c144c admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 29 13:26:33.814857 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-f6a81417-05f3-4393-8d75-1cfe3e1c144c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=100582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:26:33.815616 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-f6a81417-05f3-4393-8d75-1cfe3e1c144c admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.009883 Oct 29 13:26:33.816094 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 22/42] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Oct 29 13:26:33 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 13:26:35.163885 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-40e3b67c-8846-4c2f-b5a4-62e2debcb12e admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:35.164892 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-40e3b67c-8846-4c2f-b5a4-62e2debcb12e admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 29 13:26:35.165290 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 21/43] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:35.352680 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-12377a68-cee8-4d1d-bc35-7291aebcc1c8 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:35.357895 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.wsgi [None req-12377a68-cee8-4d1d-bc35-7291aebcc1c8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 13:26:35.358461 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-12377a68-cee8-4d1d-bc35-7291aebcc1c8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:26:35.359240 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-12377a68-cee8-4d1d-bc35-7291aebcc1c8 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057440 Oct 29 13:26:35.359742 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 23/44] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Oct 29 13:26:35 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 13:26:35.369654 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-b53273de-0342-44eb-86b1-a33fd626da38 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:35.383391 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-b53273de-0342-44eb-86b1-a33fd626da38 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017459 Oct 29 13:26:35.383849 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 22/45] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Oct 29 13:26:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:26:35.393293 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-8cdc1535-05c5-45d4-9b3d-b377e3a1e2b6 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:35.406852 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-8cdc1535-05c5-45d4-9b3d-b377e3a1e2b6 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016887 Oct 29 13:26:35.407365 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 24/46] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Oct 29 13:26:35 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:26:35.416538 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-6e442e13-3526-4cbc-829c-977133fc6582 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:35.428223 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.wsgi [None req-6e442e13-3526-4cbc-829c-977133fc6582 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 29 13:26:35.428791 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-6e442e13-3526-4cbc-829c-977133fc6582 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=100583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:26:35.429614 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-6e442e13-3526-4cbc-829c-977133fc6582 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.016401 Oct 29 13:26:35.430158 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 23/47] 10.222.0.96 () {60 vars in 1190 bytes} [Fri Oct 29 13:26:35 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 13:26:36.761242 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-8cdc1535-05c5-45d4-9b3d-b377e3a1e2b6 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:36.762318 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-8cdc1535-05c5-45d4-9b3d-b377e3a1e2b6 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 29 13:26:36.762718 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 25/48] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:36.951095 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-d209d2a7-1bed-4ca6-8333-46fb9f4cd014 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:36.956704 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.wsgi [None req-d209d2a7-1bed-4ca6-8333-46fb9f4cd014 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 13:26:36.957274 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-d209d2a7-1bed-4ca6-8333-46fb9f4cd014 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100583) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:26:36.958099 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-d209d2a7-1bed-4ca6-8333-46fb9f4cd014 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058166 Oct 29 13:26:36.958602 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 24/49] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Oct 29 13:26:36 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 29 13:26:36.968217 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-2d76dc2c-ce98-462b-ac1a-6a4ee1c856b7 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:36.982421 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-2d76dc2c-ce98-462b-ac1a-6a4ee1c856b7 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017481 Oct 29 13:26:36.983078 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 26/50] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Oct 29 13:26:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:26:36.993684 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:37.006981 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017506 Oct 29 13:26:37.007496 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 25/51] 10.222.0.96 () {60 vars in 1210 bytes} [Fri Oct 29 13:26:36 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:26:37.017159 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-163575ab-6f74-4452-b677-11e131fcce3f admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:37.022368 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.wsgi [None req-163575ab-6f74-4452-b677-11e131fcce3f admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 29 13:26:37.022928 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-163575ab-6f74-4452-b677-11e131fcce3f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=100582) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:26:37.023705 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-163575ab-6f74-4452-b677-11e131fcce3f admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010123 Oct 29 13:26:37.024192 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 27/52] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Oct 29 13:26:37 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 29 13:26:38.368426 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:38.369688 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Oct 29 13:26:38.370126 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 26/53] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:38.559951 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-af8bead4-8217-4141-b1d3-85ea82c8f543 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:26:38.577526 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-af8bead4-8217-4141-b1d3-85ea82c8f543 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068025 Oct 29 13:26:38.578072 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 28/54] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Oct 29 13:26:38 2021] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:26:39.925574 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:39.926602 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 29 13:26:39.926991 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 27/55] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:40.117406 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-231419b8-324f-49d5-9484-dcff95c78e0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:26:40.135130 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-231419b8-324f-49d5-9484-dcff95c78e0b admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.067764 Oct 29 13:26:40.135685 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 29/56] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Oct 29 13:26:40 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:26:41.482049 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:41.483049 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 29 13:26:41.483605 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 28/57] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:41.673030 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-384669e9-54a4-4760-ab2c-7142f322ce16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:26:41.690156 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-384669e9-54a4-4760-ab2c-7142f322ce16 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068376 Oct 29 13:26:41.690615 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 30/58] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Oct 29 13:26:41 2021] POST /compute/v2.1/flavors => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:26:43.036332 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:43.037458 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 29 13:26:43.037874 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 29/59] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:43.226229 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-f0966faa-fa78-4b6f-983e-78d245b5c1b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:26:43.243418 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-f0966faa-fa78-4b6f-983e-78d245b5c1b6 admin admin] 10.222.0.96 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067599 Oct 29 13:26:43.243950 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 31/60] 10.222.0.96 () {64 vars in 1235 bytes} [Fri Oct 29 13:26:43 2021] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:26:44.588505 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:44.589491 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Oct 29 13:26:44.589923 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 30/61] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:26:44 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:26:44.777921 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-52c502a5-1812-4fd7-b47d-d5ce89dce631 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:26:44.797242 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-52c502a5-1812-4fd7-b47d-d5ce89dce631 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069290 Oct 29 13:26:44.797846 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 32/62] 10.222.0.96 () {60 vars in 1202 bytes} [Fri Oct 29 13:26:44 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:27:29.534735 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:27:29.535737 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-bc8b8010-3d3d-4244-ae75-f6c7376267e8 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Oct 29 13:27:29.536130 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 31/63] 10.222.0.96 () {54 vars in 930 bytes} [Fri Oct 29 13:27:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:27:29.593960 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-1582fef4-6cfe-4086-9475-08d44857e0ac admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:27:29.612632 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-1582fef4-6cfe-4086-9475-08d44857e0ac admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070106 Oct 29 13:27:29.613157 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 33/64] 10.222.0.96 () {60 vars in 1291 bytes} [Fri Oct 29 13:27:29 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:27:29.635865 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-83912e90-3271-4a1c-b6a4-26286a379a7d admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:27:29.643240 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-83912e90-3271-4a1c-b6a4-26286a379a7d admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010908 Oct 29 13:27:29.643750 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 32/65] 10.222.0.96 () {60 vars in 1282 bytes} [Fri Oct 29 13:27:29 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:27:29.655579 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-0befff44-af0b-47d4-918d-b19bcd0e6c9b admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:27:29.663015 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-0befff44-af0b-47d4-918d-b19bcd0e6c9b admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010844 Oct 29 13:27:29.663523 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 34/66] 10.222.0.96 () {60 vars in 1285 bytes} [Fri Oct 29 13:27:29 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:27:29.674666 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-127fc626-ba8b-46ef-a122-724a16c8360b admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:27:29.681842 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-127fc626-ba8b-46ef-a122-724a16c8360b admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010473 Oct 29 13:27:29.682351 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 33/67] 10.222.0.96 () {60 vars in 1285 bytes} [Fri Oct 29 13:27:29 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:27:29.694099 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:27:29.702278 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] 10.222.0.96 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012052 Oct 29 13:27:29.702793 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 35/68] 10.222.0.96 () {60 vars in 1282 bytes} [Fri Oct 29 13:27:29 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:28:51.054472 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-fe56289e-8d83-4fdd-978e-bf176008549e tempest-verify_tempest_config-71695880 tempest-verify_tempest_config-71695880-project] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:28:51.056435 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-fe56289e-8d83-4fdd-978e-bf176008549e tempest-verify_tempest_config-71695880 tempest-verify_tempest_config-71695880-project] 10.222.0.96 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104042 Oct 29 13:28:51.056964 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 34/69] 10.222.0.96 () {58 vars in 1133 bytes} [Fri Oct 29 13:28:50 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:30:22.018252 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:22.019342 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 29 13:30:22.019846 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 36/70] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:30:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:30:22.277354 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-ed56a520-1769-4431-bc49-b3deafe26459 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:22.278530 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:30:22.278530 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: warnings.warn(msg) Oct 29 13:30:22.280023 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-ed56a520-1769-4431-bc49-b3deafe26459 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:22.280460 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-ed56a520-1769-4431-bc49-b3deafe26459 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:22.281904 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-ed56a520-1769-4431-bc49-b3deafe26459 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:22.282322 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-ed56a520-1769-4431-bc49-b3deafe26459 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:22.316239 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-ed56a520-1769-4431-bc49-b3deafe26459 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.151843 Oct 29 13:30:22.317019 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 35/71] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Oct 29 13:30:22 2021] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:30:23.686912 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:23.689600 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003110 Oct 29 13:30:23.690039 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 37/72] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:30:23 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:30:23.882253 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-6fa5ab79-c247-4950-bc87-5ab4728a1778 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:23.883417 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:30:23.883417 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: warnings.warn(msg) Oct 29 13:30:23.884920 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-6fa5ab79-c247-4950-bc87-5ab4728a1778 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:23.885360 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-6fa5ab79-c247-4950-bc87-5ab4728a1778 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:23.886168 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-6fa5ab79-c247-4950-bc87-5ab4728a1778 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:23.886590 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-6fa5ab79-c247-4950-bc87-5ab4728a1778 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:23.907478 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-6fa5ab79-c247-4950-bc87-5ab4728a1778 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075559 Oct 29 13:30:23.908032 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 36/73] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Oct 29 13:30:23 2021] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:30:35.673234 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:35.674274 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Oct 29 13:30:35.674667 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 38/74] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:30:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:30:35.863434 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-e09c1d4a-508c-4600-92ce-e53104104711 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:35.864609 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:30:35.864609 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: warnings.warn(msg) Oct 29 13:30:35.866116 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-e09c1d4a-508c-4600-92ce-e53104104711 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:35.866553 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-e09c1d4a-508c-4600-92ce-e53104104711 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:35.867326 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-e09c1d4a-508c-4600-92ce-e53104104711 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:35.867741 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-e09c1d4a-508c-4600-92ce-e53104104711 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:35.892130 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-e09c1d4a-508c-4600-92ce-e53104104711 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079806 Oct 29 13:30:35.892602 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 37/75] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Oct 29 13:30:35 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:30:37.261636 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: DEBUG nova.api.openstack.wsgi [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] Calling method '>' {{(pid=100582) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:37.262666 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: INFO nova.api.openstack.requestlog [None req-ba29b00e-c2bc-4e82-ab6f-a43d8290a629 admin admin] 10.222.0.96 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 29 13:30:37.263066 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: [pid: 100582|app: 0|req: 39/76] 10.222.0.96 () {56 vars in 1074 bytes} [Fri Oct 29 13:30:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:30:37.452804 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG nova.api.openstack.wsgi [None req-4b504d16-6e1d-4461-96f5-781bdf32b401 admin admin] Calling method '>' {{(pid=100583) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:30:37.453982 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:30:37.453982 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: warnings.warn(msg) Oct 29 13:30:37.455526 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-4b504d16-6e1d-4461-96f5-781bdf32b401 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:37.455962 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-4b504d16-6e1d-4461-96f5-781bdf32b401 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:37.456737 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-4b504d16-6e1d-4461-96f5-781bdf32b401 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:30:37.457180 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: DEBUG oslo_concurrency.lockutils [None req-4b504d16-6e1d-4461-96f5-781bdf32b401 admin admin] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=100583) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:30:37.477716 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: INFO nova.api.openstack.requestlog [None req-4b504d16-6e1d-4461-96f5-781bdf32b401 admin admin] 10.222.0.96 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075141 Oct 29 13:30:37.478274 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: [pid: 100583|app: 0|req: 38/77] 10.222.0.96 () {60 vars in 1193 bytes} [Fri Oct 29 13:30:37 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:31:35.122451 dv-cinder-815884-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 29 13:31:35.122967 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: Fri Oct 29 13:31:35 2021 - graceful shutdown triggered... Oct 29 13:31:35.123414 dv-cinder-815884-1-iscsi devstack@n-api.service[100583]: Gracefully killing worker 2 (pid: 100583)... Oct 29 13:31:35.124834 dv-cinder-815884-1-iscsi devstack@n-api.service[100582]: Gracefully killing worker 1 (pid: 100582)... Oct 29 13:31:36.124276 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: worker 1 buried after 1 seconds Oct 29 13:31:36.124821 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: worker 2 buried after 1 seconds Oct 29 13:31:36.124821 dv-cinder-815884-1-iscsi devstack@n-api.service[100581]: goodbye to uWSGI. Oct 29 13:31:36.125841 dv-cinder-815884-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 29 13:31:36.126409 dv-cinder-815884-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 29 13:31:36.129184 dv-cinder-815884-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 29 13:31:36.138097 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 13:31:36 2021] *** Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: nodename: dv-cinder-815884-1-iscsi Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: machine: x86_64 Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: clock source: unix Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: pcre jit disabled Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: detected number of CPU cores: 4 Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: current working directory: / Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: detected binary path: /usr/bin/uwsgi-core Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: your processes number limit is 47680 Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: your memory page size is 4096 bytes Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: detected max file descriptor number: 2048 Oct 29 13:31:36.140706 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: lock engine: pthread robust mutexes Oct 29 13:31:36.141616 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: thunder lock: enabled Oct 29 13:31:36.141616 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 29 13:31:36.141616 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 13:31:36.184835 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: Python main interpreter initialized at 0x557786f609c0 Oct 29 13:31:36.184835 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: python threads support enabled Oct 29 13:31:36.184835 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: your server socket listen backlog is limited to 100 connections Oct 29 13:31:36.184835 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: your mercy for graceful operations on workers is 90 seconds Oct 29 13:31:36.185257 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 13:31:36.185257 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: *** Operational MODE: preforking *** Oct 29 13:31:36.185563 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: *** uWSGI is running in multiple interpreter mode *** Oct 29 13:31:36.185563 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: spawned uWSGI master process (pid: 122206) Oct 29 13:31:36.185761 dv-cinder-815884-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 29 13:31:36.187716 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: spawned uWSGI worker 1 (pid: 122215, cores: 1) Oct 29 13:31:36.187921 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: spawned uWSGI worker 2 (pid: 122216, cores: 1) Oct 29 13:31:36.188082 dv-cinder-815884-1-iscsi devstack@n-api.service[122206]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 13:31:37.972007 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:31:37.972007 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: from cryptography.utils import int_from_bytes Oct 29 13:31:37.972686 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:31:37.972686 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: from cryptography.utils import int_from_bytes Oct 29 13:31:37.986307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:31:37.986307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: from cryptography.utils import int_from_bytes Oct 29 13:31:37.986824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 13:31:37.986824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: from cryptography.utils import int_from_bytes Oct 29 13:31:40.571591 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 13:31:40.571591 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 13:31:40.571591 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 13:31:40.572243 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 13:31:40.572243 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 13:31:40.572657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.572856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.573118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.573440 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.573786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.574183 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.574504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.574823 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.577371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.577371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.577371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.577371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815884-1-iscsi {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.577371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.577371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.578115 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.578115 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.578115 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.578446 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.578704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.579210 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.580455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.580455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.580640 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.580994 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.581215 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.581519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.581869 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.582179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.582509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.582831 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.583226 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815884-1-iscsi {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.583546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.583857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.584190 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.584805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.585113 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.585436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.585755 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.586097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.586406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.586729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.587049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.587381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.587691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.587992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.588298 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.588612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.588932 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.589227 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.589534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.589803 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.590113 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.590435 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.590752 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.591080 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.591331 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.591578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.591893 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.592246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.592554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.592861 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.593169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.593467 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.593806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.594107 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.594409 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.594712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.595026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.595341 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.595662 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.595972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.596281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.596686 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.596934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.597238 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.597579 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.597939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.598232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.598552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.598871 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.599176 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.599481 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.599788 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.600097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.600422 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.600729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.600984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.601285 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.601590 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.602005 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.602321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.602627 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.602931 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.603230 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.603534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.603839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.604150 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.604446 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.604752 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.605054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.605359 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.605660 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.605983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.606299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.606615 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.606920 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.607222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.607525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.607884 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.608202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.608505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.608819 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.609128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.609427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.609730 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.610071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.610375 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.610681 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.611001 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.611297 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.611599 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.611914 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.612218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.612523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.612819 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.613121 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.613424 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.613722 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.614044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.614343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.614641 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.614954 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.615271 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.615577 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.615879 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.616179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.616493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.616830 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.617158 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.617501 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.617836 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.618168 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.618495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.618813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.619122 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.619439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.619762 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.620073 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.620383 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.620690 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.621013 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.621333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.621658 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.622252 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.622578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.622894 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.623203 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.624064 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.624414 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.624712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.625022 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.625360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.625699 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.626061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.626385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.626695 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.627016 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.627215 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 13:31:40.627694 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.627856 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 13:31:40.628005 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.628005 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.628319 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 13:31:40.628475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.628634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 13:31:40.628780 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.628949 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 13:31:40.629105 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.629250 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.629411 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.629567 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.629717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.629904 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.630051 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.630203 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.630364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.630519 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.630663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.631021 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.631186 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.631349 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.631744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.631909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.631909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.632206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.632350 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.632500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.632669 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.632883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.633042 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-815884-1-iscsi {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.633196 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.633360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.633516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.633667 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.633851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.634016 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.634259 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.634422 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.634578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.634751 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.634980 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.635138 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.635318 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.635564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.635742 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.635742 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.636032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.636196 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.636342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.636493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.636644 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.636794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.636952 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.637097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.637245 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.637412 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.637564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.637723 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.637960 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.638116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.638260 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.638404 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.638555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.638707 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.638860 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.639003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.639212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.639856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.639856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.640165 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-815884-1-iscsi {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.640320 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.640465 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.640465 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.640870 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.641248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.641401 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.641401 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.641907 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.642071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.642226 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.642379 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.642544 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.642697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.642866 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.643090 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.643254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.643399 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.643549 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.643697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.643697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.643983 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.644137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.644375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.644546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.644692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.644835 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.645011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.645241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.645398 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.645570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.645835 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.645989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.646151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.646310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.646455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.646599 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.646756 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.647007 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.647174 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.647319 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.647462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.647613 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.647758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.647901 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.648057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.648208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.648360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.648503 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.648646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.648817 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.648972 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.648972 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.649248 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.649391 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.649552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.649927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.650091 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.650236 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.650388 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.650533 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.650687 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.650841 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.650986 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.651361 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.651525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.651670 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.651848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.652167 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.652313 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.652465 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.652620 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.652773 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.652924 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.653106 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.653332 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.653482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.653633 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.653803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.653964 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.654120 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.654264 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.654492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.654651 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.654824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.96 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.654975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.655222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.96 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.655457 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.655622 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.655767 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.655918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.656169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.656334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.656480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.656624 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.656774 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.656918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.657068 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.657222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.657383 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.657550 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.657694 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.657871 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.658028 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.658173 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.658325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.658470 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.658614 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.658756 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.658918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.659063 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.659205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.659373 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.659524 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.659668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.659820 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.659965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.660119 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.660263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.660405 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.660555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.660707 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.660851 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.661002 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.661146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.661539 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.661703 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.661903 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.662230 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.662381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.662527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.662671 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.662895 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.663042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.663195 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.663355 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.663583 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.663733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.663902 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.664048 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.664191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.664342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.664504 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.664724 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.664882 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.665027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.665184 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.665330 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.665488 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.665717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.665899 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.666057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.666224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.666461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.666616 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.666777 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.666929 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.667084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.667237 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.667381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.667524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.667667 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.667818 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.667963 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.668126 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.668279 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.668422 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.668565 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.668708 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.668860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.669012 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.669157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.669299 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.669441 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.669593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.669745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.669937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.670090 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.670235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.670410 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.670564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.670717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.670874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.671026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.671169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.671312 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.671474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.671856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.672005 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.672176 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.672495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.672648 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.672814 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.672979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.673127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.673279 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.673423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.673585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.673852 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.674016 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.674169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.674312 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.674467 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.674611 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.674854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.675061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.675209 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.675353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.675503 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.675664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.675910 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.676060 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.676205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 13:31:40.676358 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.676821 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.676998 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.677148 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.677343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.677494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.677639 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.677811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.677971 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.678124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.678271 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.678433 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.678580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.678731 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.678897 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679484 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679642 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.679939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.680219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.680363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.680515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.680659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.680659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.680967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.681119 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.681119 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.681406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.681559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.681995 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682153 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.682299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.683677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.684976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.684976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.684976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.685417 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.685564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.685564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.685564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.686974 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.687139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.687284 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.687427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.687427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.687723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.687876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.688039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.688195 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.688348 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.688492 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.688717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.688872 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.689024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.689176 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.689319 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.689470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.689628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.689800 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.689950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.690116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.690268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.690427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.690571 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.690721 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.690866 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.691018 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.691169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.691327 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.691479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.691630 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.691630 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.692182 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.692343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.692503 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.692834 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.692987 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.693139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.693331 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.693479 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.693636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.693801 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.693953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.694195 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.694354 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.694526 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.694680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.694824 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.694994 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.695208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.695359 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.695517 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.695677 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.695847 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.696074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.696232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.696387 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.696542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.696716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.696954 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.697202 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.697360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.697512 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.697667 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.697889 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.698049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.698203 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.698347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.698347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.698630 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.698774 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.698928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.699079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.699231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.699384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.699528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.699680 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.699823 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.699973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.700117 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.700274 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.700427 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.700570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.700723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.700723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.700996 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.701147 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.701294 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.701444 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.701637 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.702453 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.702604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.702784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.703100 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.703247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.703393 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.703556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.703715 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.703715 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.703999 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.704160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.704388 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.704538 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.704696 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.704849 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.705001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.705145 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.705385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.705537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.705706 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.705900 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.706165 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.706325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.706473 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.706618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.706775 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.706939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.707154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.707407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.707558 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.707717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.707862 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.708017 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.708161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.708304 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.708447 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.708600 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.708754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.708905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.709049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.709191 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.709342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.709500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.709653 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.709826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.709988 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.710142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.710294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.710446 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.710590 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.710735 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.710878 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.711032 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.711195 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.711340 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.711490 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.711633 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.711827 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.711983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.712142 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.712286 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.712598 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.712750 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.712897 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.713221 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.713385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.713531 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.713682 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.713879 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.714029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.714195 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.714368 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.714582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.714742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.714888 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.715032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.715190 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.715335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.715568 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.715717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.715860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.715860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.716251 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.716480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.716630 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.716782 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.716935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.717081 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.717338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.717589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.717749 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.717917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.718074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.718219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.718371 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.718729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.718900 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.719248 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.719364 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.719486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.719601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.719712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.719822 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.719943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.720064 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.720261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.720384 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.720504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.720661 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.720787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.720900 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.721019 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.721139 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.721260 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.721372 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.721489 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.721608 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.721728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.722113 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.722288 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.722449 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.722783 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.722941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.723125 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.723445 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.723603 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.723763 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.723915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.724075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.724233 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.724385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.724623 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.724884 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.725049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.725224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.725386 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.725558 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.725857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726187 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726745 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726847 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726921 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.726998 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727086 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727159 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727238 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727331 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727416 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727502 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727768 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.727934 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728006 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728154 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728227 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728304 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728521 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728602 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728674 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728820 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728820 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.728964 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729132 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729527 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729760 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729902 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.729979 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730197 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730391 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730816 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730816 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.730982 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731399 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731690 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731825 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.731990 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.732210 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.732350 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.732969 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.733139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.733234 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.733557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.733673 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.733806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.733900 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.733900 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.734073 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.734202 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.734637 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.734757 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.734872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.734969 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.735137 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.735462 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.735605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.735840 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.735949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.736089 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.736355 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.736506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.737103 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.737227 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.737317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.737692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.737986 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.738104 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.738204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.738351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.738824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.738934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.739044 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.739439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.739559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.739690 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.739787 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.739883 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.740091 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.740259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.740445 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.740710 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.740828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.741063 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.741462 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.741666 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.741666 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.742217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.742322 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.742417 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.742520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.742607 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.743052 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.743162 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.743249 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.743887 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.744010 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.744110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.744198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.744298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.744680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.744799 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.744889 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.745343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.745464 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.745464 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.745637 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.745812 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.745995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.746167 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.746326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.746653 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.747502 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.747617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.747715 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.747802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.747986 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.748425 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.749221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.749221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.749415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.749543 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.749650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.750111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.750226 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.750325 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.750641 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.750761 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.750862 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.751154 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.751311 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.751472 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.751724 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.751858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.752100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.752447 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.752594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.752857 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.752988 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.753285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.753390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.753479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.753640 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.754234 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.754347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.754455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.754555 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.754651 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.755036 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.755146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.755235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.755489 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.755779 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.755944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.756180 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.756360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.756539 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.756701 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.756966 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.757122 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.757313 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.757468 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.757696 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.757908 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.758274 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.758382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.758759 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.758879 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.758978 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.759275 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.759478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.759757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.759874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.760090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.760399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.760790 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.760901 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.761077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.761305 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.761550 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.761650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.762010 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.762288 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.762474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.762585 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.763124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.763260 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.763555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.763555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.763803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.764009 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.765078 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.765078 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.765353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.765572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.765572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.766024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.766157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.766275 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.766516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.766758 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.766875 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.767159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.767434 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.767581 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.767834 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.767951 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.768132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.768457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.768562 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.768782 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.769084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.769178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.769416 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.769658 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.769754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.770055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.770266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.770360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.770682 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.770835 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.771001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.771311 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.771402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.771624 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.771901 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.772004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.772259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.772474 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.772570 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.772934 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.773083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776101 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776328 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776328 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776492 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776606 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776694 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776778 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776863 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.776946 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777030 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777439 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.777943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778553 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.778968 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.779053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.779053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.779318 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.779561 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.779678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.779962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.780064 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.780273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.780556 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.780721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.781043 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.781135 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.781367 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782155 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782252 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782348 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782603 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782846 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.782940 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.783224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.783805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.783935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.784033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.784266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.784361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.784584 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.784849 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.784975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.785290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.785422 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.785609 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.786157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.786271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.786271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.786500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.786595 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.786876 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.787099 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.787208 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.787538 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.787652 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.787823 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.788156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.788257 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.788667 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.788784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.788888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.789209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.789310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.789576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.789844 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.789964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.790263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.790435 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.790594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.790927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.791037 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.791246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.791541 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.791643 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.791877 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.792145 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.792241 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.792514 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.792726 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.792819 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.793143 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.793346 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.793448 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.793824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.793924 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.794123 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.794444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.794557 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.794995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.795108 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.795196 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.795532 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.795637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.795850 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.796344 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.796463 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.796567 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.796655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.796803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.797116 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.797232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.797478 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.797593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.797930 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.798056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.798248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.798342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.798578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.798695 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.798898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.799030 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.799219 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.799333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.799537 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.799631 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.799871 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.799967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.800168 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.800261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.800480 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.800573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.800810 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.800905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.801130 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.801231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.801448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.801556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.801812 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.801923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.802119 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.802330 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.802432 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.802647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.802749 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.802985 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.803086 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.803315 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.803410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.803643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.803736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.803956 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.804048 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.804265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.804365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.804594 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.804687 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.804903 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.804996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.805214 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.805316 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.805528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.805622 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.805861 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.805970 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.806207 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.806328 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.806491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.806583 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.806802 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.806896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.807109 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.807225 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.807428 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.807523 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.807738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.807844 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.808086 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.808266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.808393 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.808619 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.808721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.809002 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.809122 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.809262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.809357 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.809587 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.809680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.809935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.810042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.810246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.810339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.810553 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.810644 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.810865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.811547 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.811709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.811802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.812025 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.812123 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.812336 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.812442 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.812643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.812737 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.812949 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.813049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.813259 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.813352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.813565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.813656 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.813889 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.813997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.814202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.814304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.814506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.814600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.814833 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.814926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.815139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.815255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.815443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.815538 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.815748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.815859 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.816059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.816153 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.816367 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.816487 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.816669 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.816778 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.816974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.817068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.817280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.817386 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.817589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.817693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.817915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.818023 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.818225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.818319 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.818529 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.818782 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.818876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.819117 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.819234 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.819434 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.819542 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.819738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.819832 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.820062 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.820351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.820454 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.820663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.820975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.821285 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.821652 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.821944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.822055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.822257 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.822384 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.822604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.822741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.822922 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.823092 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.823447 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.823549 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.823785 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.823874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.824125 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.824220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.824463 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.824545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.824800 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.824913 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.825173 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.825290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.825484 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.825811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.825968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.826134 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.826443 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.826566 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.827291 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.827419 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.827606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.827770 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.827918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.828113 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.828231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.828563 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.828655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.828887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.828989 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.829206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.829321 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.829507 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.829605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.829971 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.830084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.830298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.830393 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.830622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.830719 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.830941 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.831042 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.831260 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.831354 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.831574 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.831668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.831885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.831979 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.832196 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.832314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.832507 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.832649 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.832824 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.832975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.833159 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.833300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.833475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.833636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.833788 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.833999 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.834244 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.834339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.834562 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.834739 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.834883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.834984 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.835205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.835307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.835515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.835620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.835836 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.835938 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.836156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.836463 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.836582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.836786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.836913 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.837098 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.837262 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.837431 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.837601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.837853 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.837979 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.838121 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.838305 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.838444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.838637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.838742 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.838978 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.839071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.839298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.839400 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.839617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.839730 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.839937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.840031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.840255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.840358 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.840565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.840664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.840883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.841009 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.841204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.841305 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.841512 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.841604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.841855 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.841965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.842174 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.842345 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.842537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.842736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.842856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.843081 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.843185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.843412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.843506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.843745 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.843839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.844078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.844180 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.844390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.844483 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.844700 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.844803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.845011 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.845115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.845328 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.845428 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.845641 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.845734 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.845971 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.846154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.846295 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.846390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.846605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.846693 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.846925 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.847026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.847238 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.847340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.847553 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.847678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.847880 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.847991 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.848192 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.848298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.848506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.848599 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.848816 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.848918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.849127 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.849219 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.849443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.849559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.849758 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.849894 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.850103 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.850199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.850425 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.850533 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.850749 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.850849 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.851057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.851149 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.851368 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.851471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.851687 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.851780 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.851996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.852096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.852309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.852413 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.852581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122215) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 13:31:40.852680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.852923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.853233 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.853555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.853889 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.854223 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.854535 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.854844 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.855166 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.855484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.855815 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.856134 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.856452 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.856833 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.857155 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.857695 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.858089 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.858437 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.858861 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.859212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.859529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.859849 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.860161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.860490 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.860808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.861124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.861442 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.861758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.862095 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.862412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.862731 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.863048 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.863371 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.863717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.864043 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.864369 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.864692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.865016 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.865331 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.865646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.865989 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.866306 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.866627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.866968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.867287 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.867600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.868033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.868352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.868677 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.869004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.869319 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.869966 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.869966 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.870411 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.870644 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.870965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.871297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.871644 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.871977 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.872574 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.872886 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.873230 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.874105 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.874446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.874771 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.875094 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.875427 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.875746 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.875935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_db.sqlalchemy.engines [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:40.876074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.876393 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.876721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.877050 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.877375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.877700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.878061 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.878376 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.878693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.879015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.879329 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.879645 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.879963 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.880294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.880625 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.880941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.881269 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.881594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.881951 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.882275 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.882591 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.882926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.883242 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.883571 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.883888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.884205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.884528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.884852 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.885181 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.885512 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.885872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.886263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.886622 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.886943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.887294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.887626 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 13:31:40.888247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122216) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 13:31:40.910709 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:40.956461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.context [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0fd04116-658c-4f9b-9b80-4c1c1d069e0f(cell1) {{(pid=122215) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 13:31:40.960898 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:31:40.962521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:31:40.963341 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:31:40.965278 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:31:40.975817 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_db.sqlalchemy.engines [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:40.977117 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_db.sqlalchemy.engines [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:40.989742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.context [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0fd04116-658c-4f9b-9b80-4c1c1d069e0f(cell1) {{(pid=122216) load_cells /opt/stack/nova/nova/context.py:464}} Oct 29 13:31:40.994205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:31:40.995813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:31:40.996625 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:31:40.999474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:31:41.010374 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:41.011297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:41.239953 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_db.sqlalchemy.engines [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122215) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:41.272091 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_db.sqlalchemy.engines [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122216) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 13:31:41.570968 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: WARNING keystonemiddleware.auth_token [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:31:41.578328 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: WARNING keystonemiddleware.auth_token [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:31:41.599543 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: WARNING keystonemiddleware.auth_token [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:31:41.606314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: WARNING keystonemiddleware.auth_token [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:31:41.925713 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: WARNING keystonemiddleware.auth_token [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:31:41.931077 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: WARNING keystonemiddleware.auth_token [None req-f93810de-c368-4f3d-adb9-7d628f241be5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:31:41.936239 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557786f609c0 pid: 122215 (default app) Oct 29 13:31:41.957042 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: WARNING keystonemiddleware.auth_token [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 29 13:31:41.962493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: WARNING keystonemiddleware.auth_token [None req-5dd15b6d-4bfb-441a-9b72-a95bfaaff0bf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 29 13:31:41.968255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557786f609c0 pid: 122216 (default app) Oct 29 13:32:21.865307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d39c3764-eb38-4cd9-bbcf-06d5c0a9e45a tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547d174550>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:22.168641 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-68857197-82c5-40b1-935e-938661bad5e7 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Action: 'create', calling method: .version_select at 0x7f547d129940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1385574000", "metadata": {"Type": "work"}}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:22.171659 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-68857197-82c5-40b1-935e-938661bad5e7 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:32:22.172828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-68857197-82c5-40b1-935e-938661bad5e7 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.896060 Oct 29 13:32:22.174171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 1/1] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Oct 29 13:32:21 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 899 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 13:32:22.184284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f4d0be5e-1f04-4220-8a33-5de8a8ad014e tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Action: 'create', calling method: .version_select at 0x7f547d0ef4c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1898653601", "metadata": {"Type": "work"}}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:22.186536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f4d0be5e-1f04-4220-8a33-5de8a8ad014e tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:32:22.190612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f4d0be5e-1f04-4220-8a33-5de8a8ad014e tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011451 Oct 29 13:32:22.191744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 2/2] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Oct 29 13:32:22 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 13:32:22.203373 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-aed35967-4207-45fa-bf84-919f0abf8842 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Action: 'create', calling method: .version_select at 0x7f547d129940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1910547615", "metadata": {"Type": "work"}}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:22.206147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-aed35967-4207-45fa-bf84-919f0abf8842 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:32:22.209544 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-aed35967-4207-45fa-bf84-919f0abf8842 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009864 Oct 29 13:32:22.210407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 3/3] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Oct 29 13:32:22 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 13:32:22.222765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ad42e950-dfe2-4f84-9b3f-ad10ab71b0fc tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Calling method '.version_select at 0x7f547d0cc4c0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:22.619715 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d39c3764-eb38-4cd9-bbcf-06d5c0a9e45a tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/08d5ea65-b529-4d90-a004-d73cd02bb387" status: 200 len: 351 microversion: 2.1 time: 1.122134 Oct 29 13:32:22.620849 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 1/4] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:32:21 2021] GET /compute/v2.1/os-volumes/08d5ea65-b529-4d90-a004-d73cd02bb387 => generated 351 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:32:22.800075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-ad42e950-dfe2-4f84-9b3f-ad10ab71b0fc tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] HTTP exception thrown: Volume tempest-invalid-1243743968 could not be found. Oct 29 13:32:22.800781 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ad42e950-dfe2-4f84-9b3f-ad10ab71b0fc tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Returning 404 to user: Volume tempest-invalid-1243743968 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:32:22.801676 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ad42e950-dfe2-4f84-9b3f-ad10ab71b0fc tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1243743968" status: 404 len: 99 microversion: 2.1 time: 0.582812 Oct 29 13:32:22.802204 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 4/5] 10.222.0.96 () {58 vars in 1217 bytes} [Fri Oct 29 13:32:22 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1243743968 => generated 99 bytes in 584 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 29 13:32:22.811415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9a7758f1-bfc7-4056-8267-7f03cd7f2baa tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004076 Oct 29 13:32:22.812220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 5/6] 10.222.0.96 () {58 vars in 1139 bytes} [Fri Oct 29 13:32:22 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 29 13:32:22.823354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2daed6ff-5ff3-43ef-ba96-58be62c9d012 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006135 Oct 29 13:32:22.825977 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 6/7] 10.222.0.96 () {58 vars in 1136 bytes} [Fri Oct 29 13:32:22 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 29 13:32:22.837645 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8157ece9-84b8-46c6-9832-6da844ea93c8 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Calling method '.version_select at 0x7f547cff99d0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:22.887526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-339447793", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "a19c288c-9b16-49c5-b361-bdd6bc6553ae"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:23.087494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] validate_networks() for [('a19c288c-9b16-49c5-b361-bdd6bc6553ae', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:32:23.371370 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-8157ece9-84b8-46c6-9832-6da844ea93c8 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] HTTP exception thrown: Volume cd23e13c-d3c3-4f59-ba9e-bd3e88a63b90 could not be found. Oct 29 13:32:23.372067 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8157ece9-84b8-46c6-9832-6da844ea93c8 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Returning 404 to user: Volume cd23e13c-d3c3-4f59-ba9e-bd3e88a63b90 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:32:23.373559 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8157ece9-84b8-46c6-9832-6da844ea93c8 tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/cd23e13c-d3c3-4f59-ba9e-bd3e88a63b90" status: 404 len: 109 microversion: 2.1 time: 0.540295 Oct 29 13:32:23.374123 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 7/8] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Oct 29 13:32:22 2021] DELETE /compute/v2.1/os-volumes/cd23e13c-d3c3-4f59-ba9e-bd3e88a63b90 => generated 109 bytes in 541 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:32:23.383201 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fe6b0092-cfdb-4873-9f82-43d14940d3dd tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Calling method '.version_select at 0x7f547cff9670>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:23.470433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-fe6b0092-cfdb-4873-9f82-43d14940d3dd tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] HTTP exception thrown: Volume 454662cc-3dd6-4da1-a513-227be7884d22 could not be found. Oct 29 13:32:23.471034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fe6b0092-cfdb-4873-9f82-43d14940d3dd tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] Returning 404 to user: Volume 454662cc-3dd6-4da1-a513-227be7884d22 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:32:23.472528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fe6b0092-cfdb-4873-9f82-43d14940d3dd tempest-VolumesNegativeTest-87692152 tempest-VolumesNegativeTest-87692152-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/454662cc-3dd6-4da1-a513-227be7884d22" status: 404 len: 109 microversion: 2.1 time: 0.092513 Oct 29 13:32:23.479458 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 8/9] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:32:23 2021] GET /compute/v2.1/os-volumes/454662cc-3dd6-4da1-a513-227be7884d22 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:32:24.036447 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-305973181", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "797a2d64-a318-481c-b064-119a76b4777f"}]}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:24.157813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] validate_networks() for [('797a2d64-a318-481c-b064-119a76b4777f', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:32:24.604391 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:32:24.604895 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:32:24.606183 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:32:24.608097 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:32:24.608520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:32:24.636732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:24.638111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:24.638927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:24.640525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:24.707687 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Getting quotas for project 14990b53311b47f3839dcf8442e0b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:24.721205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Getting quotas for user 8c9639d40a9f4cac946ff358215d9d33 and project 14990b53311b47f3839dcf8442e0b79e. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:24.752528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:32:24.758734 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:32:25.006431 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-424049c2-7ce9-4543-b772-6d90a33ee5cc tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.206980 Oct 29 13:32:25.007074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 2/10] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:32:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 2209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:32:25.026510 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-aadcdfe8-d32d-4908-abb6-5908f72e6a4c tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c6f8ca0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:25.246345 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-aadcdfe8-d32d-4908-abb6-5908f72e6a4c tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/b845796f-40f9-45df-ad81-ff2b676808e3" status: 200 len: 351 microversion: 2.1 time: 0.223988 Oct 29 13:32:25.247642 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 3/11] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:32:25 2021] GET /compute/v2.1/os-volumes/b845796f-40f9-45df-ad81-ff2b676808e3 => generated 351 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:32:25.256874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6f389564-cb76-4d7b-a31c-d25b0ea54acb tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:25.257829 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6f389564-cb76-4d7b-a31c-d25b0ea54acb tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:25.487408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6f389564-cb76-4d7b-a31c-d25b0ea54acb tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:25.512368 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6f389564-cb76-4d7b-a31c-d25b0ea54acb tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1214 microversion: 2.1 time: 0.263504 Oct 29 13:32:25.515218 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 4/12] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:25 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1214 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:26.531072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ed1a9a30-dc23-4f34-9596-a2cb4ee5425a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:26.531072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ed1a9a30-dc23-4f34-9596-a2cb4ee5425a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:26.650006 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:32:26.650597 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:32:26.651835 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:32:26.652470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:32:26.653042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:32:26.717231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:26.719626 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:26.724209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:26.725411 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:26.789821 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:26.802092 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for user b827e16aad5a47d0bfeebfc3da8a94b9 and project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:26.817225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:32:26.821615 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:32:26.897447 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ed1a9a30-dc23-4f34-9596-a2cb4ee5425a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:26.897447 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ed1a9a30-dc23-4f34-9596-a2cb4ee5425a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1214 microversion: 2.1 time: 0.343351 Oct 29 13:32:26.897447 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 5/13] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:26 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1214 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:27.114648 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-533f2c09-a556-4278-aaca-30867916b04a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.228074 Oct 29 13:32:27.120772 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 9/14] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:32:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 3235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 13:32:27.126847 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-87df3c41-6965-48c7-ad0a-4424b18e59fc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:27.127526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-87df3c41-6965-48c7-ad0a-4424b18e59fc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:27.329336 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5e9d3804-e4b4-4d7a-abad-cf6392ed5518 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c7081f0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:27.467231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5e9d3804-e4b4-4d7a-abad-cf6392ed5518 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/920f8cc7-cbdc-4558-9290-a46ac9e3ffd6" status: 200 len: 351 microversion: 2.1 time: 0.142402 Oct 29 13:32:27.467807 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 10/15] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:32:27 2021] GET /compute/v2.1/os-volumes/920f8cc7-cbdc-4558-9290-a46ac9e3ffd6 => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:32:27.479449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5739f4e6-e09a-4ba4-950a-ca6f7dacc05c tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c708ee0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:27.702600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-87df3c41-6965-48c7-ad0a-4424b18e59fc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:27.712128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-87df3c41-6965-48c7-ad0a-4424b18e59fc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1217 microversion: 2.1 time: 0.590224 Oct 29 13:32:27.712708 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 6/16] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:27 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1217 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:27.801076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5739f4e6-e09a-4ba4-950a-ca6f7dacc05c tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.325140 Oct 29 13:32:27.801652 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 11/17] 10.222.0.96 () {58 vars in 1133 bytes} [Fri Oct 29 13:32:27 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:27.815620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-03b4e798-1e0f-4a16-877f-f96128e32e6f tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c6c8700>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:27.894143 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:27.895026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:27.954924 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:27.956141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:27.958624 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:27.960864 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:28.011069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-03b4e798-1e0f-4a16-877f-f96128e32e6f tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.200285 Oct 29 13:32:28.011765 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 7/18] 10.222.0.96 () {58 vars in 1148 bytes} [Fri Oct 29 13:32:27 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:32:28.025066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c290eb61-f003-472c-9141-ab6850d3b6c2 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c6cb5e0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:28.207893 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c290eb61-f003-472c-9141-ab6850d3b6c2 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.186525 Oct 29 13:32:28.208558 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 8/19] 10.222.0.96 () {58 vars in 1133 bytes} [Fri Oct 29 13:32:28 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:28.219906 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a6f7c28f-53b8-43fa-af2c-880e27ba9592 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c6c8790>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:28.414879 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a6f7c28f-53b8-43fa-af2c-880e27ba9592 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.198948 Oct 29 13:32:28.415459 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 9/20] 10.222.0.96 () {58 vars in 1166 bytes} [Fri Oct 29 13:32:28 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:32:28.427916 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-eec205ed-e6f9-4f4f-a87c-f9b37fcd3367 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c6bd940>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:28.578717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-eec205ed-e6f9-4f4f-a87c-f9b37fcd3367 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.154513 Oct 29 13:32:28.579550 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 10/21] 10.222.0.96 () {58 vars in 1169 bytes} [Fri Oct 29 13:32:28 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:32:28.591309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1da04f6e-b44f-4048-ae99-843d62c3fc6c tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c6cb8b0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:28.649729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:28.671692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7a1f6105-0c57-4b25-bc4f-41d993004b77 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1210 microversion: 2.1 time: 0.786026 Oct 29 13:32:28.676444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 12/22] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:27 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1210 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:28.725937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1da04f6e-b44f-4048-ae99-843d62c3fc6c tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.138162 Oct 29 13:32:28.726660 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 11/23] 10.222.0.96 () {58 vars in 1154 bytes} [Fri Oct 29 13:32:28 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:28.733111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b2350c20-800c-4524-a659-45ba79fc844a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:28.733111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b2350c20-800c-4524-a659-45ba79fc844a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:28.741351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e4017daf-7193-4439-bb9e-20199c0f8cb6 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c6a6dc0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:28.847087 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b2350c20-800c-4524-a659-45ba79fc844a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:28.863722 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b2350c20-800c-4524-a659-45ba79fc844a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1217 microversion: 2.1 time: 0.136219 Oct 29 13:32:28.864854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 13/24] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:28 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:28.943315 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e4017daf-7193-4439-bb9e-20199c0f8cb6 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.205768 Oct 29 13:32:28.944126 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 12/25] 10.222.0.96 () {58 vars in 1187 bytes} [Fri Oct 29 13:32:28 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:32:28.957075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-133d3b5a-bf11-4cf6-a009-d62739716cc1 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] Calling method '.version_select at 0x7f547c64a160>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:29.166451 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-133d3b5a-bf11-4cf6-a009-d62739716cc1 tempest-VolumesTestJSON-981194877 tempest-VolumesTestJSON-981194877-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.213604 Oct 29 13:32:29.167160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 14/26] 10.222.0.96 () {58 vars in 1154 bytes} [Fri Oct 29 13:32:28 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:29.694641 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:29.695392 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:29.717746 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:29.719426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:29.721285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:29.724027 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:29.881867 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:29.882855 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:29.894164 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:29.895960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:29.897023 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:29.898437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:30.018783 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:30.040009 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-514f9bed-45b4-4ae7-9275-518be109dc61 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1210 microversion: 2.1 time: 0.349537 Oct 29 13:32:30.040625 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 13/27] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:29 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1210 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:30.101945 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:30.110186 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6b74fb7b-db20-4d47-8839-4e1c1c361e60 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1221 microversion: 2.1 time: 0.232054 Oct 29 13:32:30.124505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 15/28] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:29 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1221 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:31.059146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:31.063041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:31.070140 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:31.070929 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:31.072429 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:31.073326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:31.140217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:31.142102 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:31.154644 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:31.155211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:31.156436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:31.156693 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:31.343224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:31.360660 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-884cd3ca-9997-4843-9785-d5af10d52e3d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1213 microversion: 2.1 time: 0.232735 Oct 29 13:32:31.362979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 16/29] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:31 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:31.426636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:31.436129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a86c7f2d-fa09-434f-897d-5272ab58a164 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1266 microversion: 2.1 time: 0.382763 Oct 29 13:32:31.448638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 14/30] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:31 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1266 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:32.380208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:32.380826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:32.393054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:32.394249 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:32.396524 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:32.397733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:32.458318 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:32.459066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:32.466441 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:32.473809 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:32.474790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:32.477758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:32.832351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:32.847891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d9cc92a7-a63a-4787-8d83-e3a0a42f589a tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1272 microversion: 2.1 time: 0.390944 Oct 29 13:32:32.850313 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 15/31] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:32 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1272 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:33.847115 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:33.857221 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8959f392-bdb2-478d-9870-7b3f67234642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1275 microversion: 2.1 time: 1.481371 Oct 29 13:32:33.868751 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:33.869230 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 17/32] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:32 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1275 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:33.869324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:33.882133 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:33.885120 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:33.886032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:33.889572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:34.380630 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:34.390739 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8e85de0b-b25a-4d2f-8409-3bb1b12d7428 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.526665 Oct 29 13:32:34.395008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 16/33] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:33 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:34.886554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:34.887150 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:34.895748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:34.896273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:34.897118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:34.903141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:35.426190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:35.427042 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:35.444909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:35.445689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:35.446776 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:35.453999 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:35.952141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:35.961545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-65d3f0b8-3763-479b-a868-ac5582fee306 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1275 microversion: 2.1 time: 1.079097 Oct 29 13:32:35.966205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 18/34] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:34 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1275 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:36.997716 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:36.999059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:37.014392 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:37.020934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:37.024572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:37.025653 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:37.069000 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:37.077246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0114d726-bd20-42c8-8623-0b015cf698f7 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 1.668681 Oct 29 13:32:37.079594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 17/35] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:35 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:37.240261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:37.268113 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8dc98efd-a3d0-4516-a0eb-994b7bbd11dd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1275 microversion: 2.1 time: 0.289080 Oct 29 13:32:37.285033 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 19/36] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:36 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1275 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:38.095695 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:38.096958 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:38.107451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:38.109413 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:38.113915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:38.115107 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:38.751928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:38.766589 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c23e8651-c8ec-4dcb-83d3-df45d50211e9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.674310 Oct 29 13:32:38.767766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 18/37] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:38 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:38.779933 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:38.782127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:38.797406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:38.804449 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:38.808570 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:38.809290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:39.068605 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-1cbd3b52-63ce-4831-91f2-350bf05879a9 req-e82d0f8d-5c5b-4a11-a217-af85a236fb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9697ec88-0207-4a75-9f13-334453021731", "tag": "2f64a540-a793-4305-9ee9-6fe3b62e1388"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:39.072045 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:32:39.072045 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:32:39.097534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-1cbd3b52-63ce-4831-91f2-350bf05879a9 req-e82d0f8d-5c5b-4a11-a217-af85a236fb08 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:39.098993 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-1cbd3b52-63ce-4831-91f2-350bf05879a9 req-e82d0f8d-5c5b-4a11-a217-af85a236fb08 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:39.181293 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-1cbd3b52-63ce-4831-91f2-350bf05879a9 req-e82d0f8d-5c5b-4a11-a217-af85a236fb08 service nova] Creating event network-changed:2f64a540-a793-4305-9ee9-6fe3b62e1388 for instance 9697ec88-0207-4a75-9f13-334453021731 on hv-cinder-81588 Oct 29 13:32:39.181860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-1cbd3b52-63ce-4831-91f2-350bf05879a9 req-e82d0f8d-5c5b-4a11-a217-af85a236fb08 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122215) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 29 13:32:39.183020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40d40724-6530-4608-b962-a33ae854b860 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:39.183457 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40d40724-6530-4608-b962-a33ae854b860 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:39.190494 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40d40724-6530-4608-b962-a33ae854b860 None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:39.191362 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40d40724-6530-4608-b962-a33ae854b860 None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:39.210663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.compute.rpcapi [None req-40d40724-6530-4608-b962-a33ae854b860 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 29 13:32:39.214409 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40d40724-6530-4608-b962-a33ae854b860 None None] Releasing lock "compute-rpcapi-router" {{(pid=122215) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 29 13:32:39.286018 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-40d40724-6530-4608-b962-a33ae854b860 None None] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.132670 Oct 29 13:32:39.287271 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 20/38] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:32:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:32:39.418073 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:39.431187 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a161b028-34c1-4286-8aea-85fbc1e43c01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.662104 Oct 29 13:32:39.433363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 19/39] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:38 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:39.785662 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:39.786582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:39.810691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:39.812440 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:39.814426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:39.816576 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:40.261617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-afd85f48-4bfc-4ff9-acff-a03ca6c48ff6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'create', calling method: .version_select at 0x7f547c5e7430>, body: {"keypair": {"name": "tempest-keypair-69742292"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:40.360576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-afd85f48-4bfc-4ff9-acff-a03ca6c48ff6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:40.379963 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-afd85f48-4bfc-4ff9-acff-a03ca6c48ff6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for user 22a929341e7342ea9ad10ff06b40fbf6 and project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:40.743983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:40.762238 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2538ed44-5ccf-42e0-8bd3-de0a2a8886a3 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.980842 Oct 29 13:32:40.762824 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 21/40] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:39 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:40.784069 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:40.800481 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:40.839704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:40.841735 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:40.842748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:40.847745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:41.296675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-afd85f48-4bfc-4ff9-acff-a03ca6c48ff6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:41.312520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-afd85f48-4bfc-4ff9-acff-a03ca6c48ff6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for user 22a929341e7342ea9ad10ff06b40fbf6 and project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:41.332451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-afd85f48-4bfc-4ff9-acff-a03ca6c48ff6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 1.277577 Oct 29 13:32:41.333440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 20/41] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Oct 29 13:32:40 2021] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:41.783718 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:41.784953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:41.798578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:41.800621 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:41.803204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:41.805160 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:42.211888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:42.222942 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d8a2d8f3-9f69-43f7-afbc-7534d97b51f9 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.446459 Oct 29 13:32:42.226163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 21/42] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:41 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:42.719783 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:42.732222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2787d6b2-5302-458c-b641-dbf4d6452481 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 1.958793 Oct 29 13:32:42.733254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 22/43] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:40 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:43.244758 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:43.245376 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:43.256782 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:43.257242 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:43.260275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:43.260721 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:43.692480 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-396805457", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5f220f7-750e-495a-b9c4-c7c245afa919"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:43.749279 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:43.766871 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8416b726-fc7c-4926-abf7-2a42599aa2b4 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.525823 Oct 29 13:32:43.768022 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 23/44] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:43 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:43.772632 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:43.778832 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:43.789018 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:43.804063 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:43.804904 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:43.805765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:43.828360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] validate_networks() for [('d5f220f7-750e-495a-b9c4-c7c245afa919', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:32:45.352833 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:45.369504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-91e09cc3-e0b2-4ebb-80ee-a84517c8d7cc tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 1.599456 Oct 29 13:32:45.383582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 24/45] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:43 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:45.398683 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:45.400857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:45.425949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:45.428552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:45.429618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:45.431717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:46.256528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:32:46.257089 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:32:46.257410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:32:46.257988 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:32:46.258420 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:32:46.281094 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:46.281859 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:46.288327 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:46.289500 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:46.355011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Getting quotas for project 7078166fcf074917b62f68cae696746b. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:46.367577 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Getting quotas for user e3dc5d8516c5417dbac44f1bb59467be and project 7078166fcf074917b62f68cae696746b. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:46.399746 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:32:46.408212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:32:46.499292 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:46.508270 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-558b87ab-42aa-46b5-be66-4f036baeb391 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 1.122246 Oct 29 13:32:46.509967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 25/46] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:45 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:46.523110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-429d4a4c-5709-4519-a526-a76db3c6e82e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.536297 Oct 29 13:32:46.551073 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 22/47] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:32:42 2021] POST /compute/v2.1/servers => generated 383 bytes in 3565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:32:47.146717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7ab7a72f-b360-4c18-9fc8-4328ffed56f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'create', calling method: .version_select at 0x7f547c614dc0>, body: {"keypair": {"name": "tempest-keypair-921991843"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:47.159490 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-88f133da-b5d0-40a5-aaa0-f2997f177cd0 req-8334fc5b-c7ce-460f-bc96-a81e5de4055b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2ea5b2-033b-4585-b78d-30ba7fbd82bd", "tag": "becdb76f-bef6-416c-8357-4fa91c08d663"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:47.162076 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:32:47.162076 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:32:47.196921 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-88f133da-b5d0-40a5-aaa0-f2997f177cd0 req-8334fc5b-c7ce-460f-bc96-a81e5de4055b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:47.198222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-88f133da-b5d0-40a5-aaa0-f2997f177cd0 req-8334fc5b-c7ce-460f-bc96-a81e5de4055b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:47.240696 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-7ab7a72f-b360-4c18-9fc8-4328ffed56f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:47.259068 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-7ab7a72f-b360-4c18-9fc8-4328ffed56f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for user 4e9e6a65d8804e74b5e939ed1d4be645 and project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:47.260316 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-88f133da-b5d0-40a5-aaa0-f2997f177cd0 req-8334fc5b-c7ce-460f-bc96-a81e5de4055b service nova] Creating event network-changed:becdb76f-bef6-416c-8357-4fa91c08d663 for instance bd2ea5b2-033b-4585-b78d-30ba7fbd82bd on hv-cinder-81588 Oct 29 13:32:47.268177 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-88f133da-b5d0-40a5-aaa0-f2997f177cd0 req-8334fc5b-c7ce-460f-bc96-a81e5de4055b service nova] Acquired lock "compute-rpcapi-router" {{(pid=122216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Oct 29 13:32:47.272963 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8651ed08-bd72-47e1-831a-514dcffbd396 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:47.273414 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8651ed08-bd72-47e1-831a-514dcffbd396 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:47.274257 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8651ed08-bd72-47e1-831a-514dcffbd396 None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:47.274688 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8651ed08-bd72-47e1-831a-514dcffbd396 None None] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:47.313938 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.compute.rpcapi [None req-8651ed08-bd72-47e1-831a-514dcffbd396 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Oct 29 13:32:47.323384 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8651ed08-bd72-47e1-831a-514dcffbd396 None None] Releasing lock "compute-rpcapi-router" {{(pid=122216) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Oct 29 13:32:47.410719 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8651ed08-bd72-47e1-831a-514dcffbd396 None None] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.856804 Oct 29 13:32:47.415067 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 23/48] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:32:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:32:47.438484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:47.439191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:47.500626 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:47.501102 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:47.501888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:47.504791 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:47.574630 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-7ab7a72f-b360-4c18-9fc8-4328ffed56f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:47.591838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-7ab7a72f-b360-4c18-9fc8-4328ffed56f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for user 4e9e6a65d8804e74b5e939ed1d4be645 and project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:47.619427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7ab7a72f-b360-4c18-9fc8-4328ffed56f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.107593 Oct 29 13:32:47.620237 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 26/49] 10.222.0.96 () {62 vars in 1198 bytes} [Fri Oct 29 13:32:46 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1109 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 29 13:32:47.625454 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:47.626361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:47.633361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:47.634139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:47.635203 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:47.635855 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:48.229681 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:48.238606 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4ffd8faf-bce4-4041-a1f6-7b4c86d8c01e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.822130 Oct 29 13:32:48.245144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 24/50] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:47 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:48.250323 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:48.256150 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:48.274707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:48.275290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:48.278457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:48.279091 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:48.483980 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:48.493480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-43931e0c-9750-4102-81bd-0f3e711450cc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1225 microversion: 2.1 time: 0.871691 Oct 29 13:32:48.506142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 27/51] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:47 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1225 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:48.506142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-211637381", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b00fe28-a5bb-47a1-b3da-ae5774a84660"}], "security_groups": [{"name": "tempest-securitygroup--722375210"}], "key_name": "tempest-keypair-69742292", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:48.812230 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:48.833223 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-37673733-7c8f-4df7-9dfe-319e4b4f5450 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.582741 Oct 29 13:32:48.834998 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 25/52] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:48 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:48.857638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-12417086", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5f220f7-750e-495a-b9c4-c7c245afa919"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:48.959481 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] validate_networks() for [('d5f220f7-750e-495a-b9c4-c7c245afa919', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:32:49.038479 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] validate_networks() for [('9b00fe28-a5bb-47a1-b3da-ae5774a84660', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:32:49.854697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:32:49.855554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:32:49.856215 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:32:49.856626 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:32:49.857921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:32:49.881087 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:49.881805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:49.882970 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:49.883581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:49.910605 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:49.915112 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for user 22a929341e7342ea9ad10ff06b40fbf6 and project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:49.927095 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:32:49.929864 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:32:50.012189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-41131889-fc6a-40c6-997c-db92386da4b4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.515074 Oct 29 13:32:50.018804 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 28/53] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:32:48 2021] POST /compute/v2.1/servers => generated 401 bytes in 1523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:32:50.038385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:50.038502 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:50.047025 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:50.047477 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:50.048435 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:50.048882 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:50.392438 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:50.406622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-09084942-6d15-472f-9017-f6c5be13a718 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.386613 Oct 29 13:32:50.407794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 29/54] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:50 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:50.423128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:50.425678 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:50.438556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:32:50.438556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:32:50.438556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:32:50.438556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:32:50.438556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:32:50.466646 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:50.468490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:50.469581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:50.470875 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:50.471950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:50.472369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:50.477041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:50.477741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:50.550465 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Getting quotas for project 7078166fcf074917b62f68cae696746b. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:50.559105 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Getting quotas for user e3dc5d8516c5417dbac44f1bb59467be and project 7078166fcf074917b62f68cae696746b. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:50.599191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:32:50.609820 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:32:50.810396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7c77ba1a-81fa-481b-8c5a-39bd10e72187 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.959960 Oct 29 13:32:50.817441 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 26/55] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:32:48 2021] POST /compute/v2.1/servers => generated 383 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:32:50.819461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:50.837060 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ffe32e9c-d90f-4c95-b371-c5158eb250a6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:50.838834 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e9328cec-b69f-4783-a958-9e386e7df62f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.429180 Oct 29 13:32:50.841386 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ffe32e9c-d90f-4c95-b371-c5158eb250a6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:50.844575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 30/56] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:50 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:50.856432 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-06e33ac3-7f2f-4bc8-bdc1-37b6a6b3396a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:50.858706 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-06e33ac3-7f2f-4bc8-bdc1-37b6a6b3396a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:51.034824 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-06e33ac3-7f2f-4bc8-bdc1-37b6a6b3396a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:51.041501 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-06e33ac3-7f2f-4bc8-bdc1-37b6a6b3396a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1220 microversion: 2.1 time: 0.195574 Oct 29 13:32:51.048835 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 31/57] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:50 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1220 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:51.082427 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ffe32e9c-d90f-4c95-b371-c5158eb250a6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:51.089663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ffe32e9c-d90f-4c95-b371-c5158eb250a6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1235 microversion: 2.1 time: 0.269444 Oct 29 13:32:51.095120 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 27/58] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:50 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1235 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:51.424947 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:51.426336 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:51.434770 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:51.437311 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:51.438396 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:51.441722 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:51.823595 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:51.836621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-be23a431-3097-4798-b88d-efe1a3d06c18 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.414256 Oct 29 13:32:51.839321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 32/59] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:51 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:51.860201 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:51.860667 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:51.874520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:51.874891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:51.877891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:51.878340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:52.062089 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:52.062825 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:52.070941 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:52.075744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:52.076808 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:52.077578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:52.215460 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:52.223255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a8b53607-f3f0-45bb-bced-1ca3653aad02 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1216 microversion: 2.1 time: 0.166697 Oct 29 13:32:52.224436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 33/60] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:52 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1216 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:52.239514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:52.242691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:52.253935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:52.254625 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:52.255578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:52.256169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:52.440585 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:52.456131 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-931038b0-26d9-417c-aaa9-f17b85dfb995 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.599152 Oct 29 13:32:52.456996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 28/61] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:51 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:52.459090 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:52.469282 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-470717d3-a66e-4276-9832-cba078d40b3b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1293 microversion: 2.1 time: 0.242984 Oct 29 13:32:52.470568 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 34/62] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:52 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1293 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:52.857602 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:52.858991 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:52.867854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:52.869013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:52.870121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:52.871469 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.015560 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-30ad437e-0e12-4812-84bc-33fbdc9dcf96 req-f4c79db1-e818-4797-944d-2e877a5d296c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e36bbf99-9c28-4d21-b72b-a31707096ce3", "tag": "e4e2d45b-c9a5-4290-bade-10c339385ea2"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:53.017153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:32:53.017153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:32:53.025449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-30ad437e-0e12-4812-84bc-33fbdc9dcf96 req-f4c79db1-e818-4797-944d-2e877a5d296c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:53.025919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-30ad437e-0e12-4812-84bc-33fbdc9dcf96 req-f4c79db1-e818-4797-944d-2e877a5d296c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.038586 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-30ad437e-0e12-4812-84bc-33fbdc9dcf96 req-f4c79db1-e818-4797-944d-2e877a5d296c service nova] Creating event network-changed:e4e2d45b-c9a5-4290-bade-10c339385ea2 for instance e36bbf99-9c28-4d21-b72b-a31707096ce3 on hv-cinder-81588 Oct 29 13:32:53.044142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-30ad437e-0e12-4812-84bc-33fbdc9dcf96 req-f4c79db1-e818-4797-944d-2e877a5d296c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032871 Oct 29 13:32:53.045417 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 35/63] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:32:53.154011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:53.163988 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-88a1403f-94a9-4807-89e1-c2ed6753cf19 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.310052 Oct 29 13:32:53.173877 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 29/64] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:52 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:53.243048 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:53.243839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:53.255382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:53.258684 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.259517 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:53.259958 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.476607 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:53.477720 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:53.486402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:53.487059 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.488246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:53.488873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.490035 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:53.501705 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7dcfb4a2-6df9-49b4-acae-4f89f5dd4bd6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1278 microversion: 2.1 time: 0.263188 Oct 29 13:32:53.513161 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 36/65] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:53 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:53.519273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:53.520105 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:53.533263 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:53.536299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.537382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:53.538609 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:53.845512 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:53.856875 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-045ac548-7c7f-4f57-bfe4-3bd648327dba tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.381942 Oct 29 13:32:53.857492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 30/66] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:53 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:53.909395 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:53.924736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-10f51709-0550-40f2-84e3-1a95c3e3ef3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1293 microversion: 2.1 time: 0.417008 Oct 29 13:32:53.928107 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 37/67] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:53 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1293 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:54.169951 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-19a5715a-fdb2-4a4b-8ac0-1d9831c11c95 req-94247937-cc06-4174-a5f2-30be9c31a869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9697ec88-0207-4a75-9f13-334453021731", "name": "network-vif-plugged", "status": "completed", "tag": "2f64a540-a793-4305-9ee9-6fe3b62e1388"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:54.172434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:32:54.172434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:32:54.180651 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:54.181261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:54.194275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:54.195557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:54.198361 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-19a5715a-fdb2-4a4b-8ac0-1d9831c11c95 req-94247937-cc06-4174-a5f2-30be9c31a869 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:54.201085 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:54.201801 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:54.202422 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-19a5715a-fdb2-4a4b-8ac0-1d9831c11c95 req-94247937-cc06-4174-a5f2-30be9c31a869 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:54.231611 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-19a5715a-fdb2-4a4b-8ac0-1d9831c11c95 req-94247937-cc06-4174-a5f2-30be9c31a869 service nova] Creating event network-vif-plugged:2f64a540-a793-4305-9ee9-6fe3b62e1388 for instance 9697ec88-0207-4a75-9f13-334453021731 on hv-cinder-81588 Oct 29 13:32:54.239331 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-19a5715a-fdb2-4a4b-8ac0-1d9831c11c95 req-94247937-cc06-4174-a5f2-30be9c31a869 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331855 Oct 29 13:32:54.241082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 31/68] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:32:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:32:54.408169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1982786752", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0342d3e5-b15b-4d7b-9252-6c7510cc9cfa"}], "security_groups": [{"name": "tempest-securitygroup--1291718542"}], "key_name": "tempest-keypair-921991843", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:54.726846 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] validate_networks() for [('0342d3e5-b15b-4d7b-9252-6c7510cc9cfa', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:32:55.098258 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:55.106174 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ba05d039-f922-4c10-9735-bbe30e27fe7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.928715 Oct 29 13:32:55.106952 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 38/69] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:54 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:55.111923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:55.112684 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:55.119144 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.119885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.120815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.122197 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.262129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:32:55.262684 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:32:55.263006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:32:55.263414 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:32:55.263818 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:32:55.265376 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:55.273212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.274099 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.274867 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-628f4b8d-dfae-4cfa-960d-35a44168e86f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1278 microversion: 2.1 time: 0.166515 Oct 29 13:32:55.275263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.276292 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 39/70] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:55 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:55.278388 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.296619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:32:55.298120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:55.299404 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:55.301525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for user 4e9e6a65d8804e74b5e939ed1d4be645 and project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:32:55.316192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:32:55.317111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.319772 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:32:55.320128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.321219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.321767 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.373995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-92be3aaa-3914-444e-9067-3bce772ac8a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.971077 Oct 29 13:32:55.374852 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 32/71] 10.222.0.96 () {62 vars in 1187 bytes} [Fri Oct 29 13:32:54 2021] POST /compute/v2.1/servers => generated 402 bytes in 974 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 29 13:32:55.379407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:55.380199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:55.386382 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.387090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.388001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:55.388953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:55.544424 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:55.554138 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bf98b3c4-1404-4100-a86a-821950a812d2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.177951 Oct 29 13:32:55.554845 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 33/72] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:55 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:55.559728 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5c95159c-73e3-439e-8033-a25d351bd1b1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:55.560595 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5c95159c-73e3-439e-8033-a25d351bd1b1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:55.617065 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5c95159c-73e3-439e-8033-a25d351bd1b1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:55.624450 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5c95159c-73e3-439e-8033-a25d351bd1b1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:55.626008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5c95159c-73e3-439e-8033-a25d351bd1b1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:55.627221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5c95159c-73e3-439e-8033-a25d351bd1b1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1281 microversion: 2.20 time: 0.071201 Oct 29 13:32:55.627766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 34/73] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:32:55 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:32:55.870896 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:55.879673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-357112cc-8ce8-424c-b9d0-8c5602cc7185 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1314 microversion: 2.1 time: 0.592004 Oct 29 13:32:55.880723 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 40/74] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:55 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1314 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:56.125277 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:56.126343 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:56.133144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:56.133698 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:56.134664 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:56.135273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:56.293126 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:56.293981 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:56.303513 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:56.306709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:56.311418 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:56.314183 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:56.317531 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:56.372280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-59449f12-dd19-476e-bb70-99df2414434f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.237167 Oct 29 13:32:56.373219 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 35/75] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:56 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:56.494263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-e053f792-1de2-43f0-ae3d-db4c43d4f859 req-89bbb513-67ef-4d50-bebf-824a0aa32660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2ea5b2-033b-4585-b78d-30ba7fbd82bd", "name": "network-vif-plugged", "status": "completed", "tag": "becdb76f-bef6-416c-8357-4fa91c08d663"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:56.497524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:32:56.497524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:32:56.514601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e053f792-1de2-43f0-ae3d-db4c43d4f859 req-89bbb513-67ef-4d50-bebf-824a0aa32660 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:56.515327 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e053f792-1de2-43f0-ae3d-db4c43d4f859 req-89bbb513-67ef-4d50-bebf-824a0aa32660 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:56.545394 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-e053f792-1de2-43f0-ae3d-db4c43d4f859 req-89bbb513-67ef-4d50-bebf-824a0aa32660 service nova] Creating event network-vif-plugged:becdb76f-bef6-416c-8357-4fa91c08d663 for instance bd2ea5b2-033b-4585-b78d-30ba7fbd82bd on hv-cinder-81588 Oct 29 13:32:56.561159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-e053f792-1de2-43f0-ae3d-db4c43d4f859 req-89bbb513-67ef-4d50-bebf-824a0aa32660 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070482 Oct 29 13:32:56.561761 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 36/76] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:32:56.579277 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:56.580186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:56.592388 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:56.595515 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:56.596869 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:56.597659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.004635 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:57.016355 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3e837dca-d24a-4062-8b47-cbd7acdee673 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.449407 Oct 29 13:32:57.016935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 37/77] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:56 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:57.024854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:57.027411 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:57.040842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:57.041280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.044230 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:57.044673 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.231723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:57.241818 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:57.243189 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:57.244295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fc3e465a-b0bf-4de5-8163-69500c0871d1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1339 microversion: 2.20 time: 0.225963 Oct 29 13:32:57.244842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 38/78] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:32:57 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1339 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:32:57.262624 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:57.263300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:57.278101 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:57.278551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.279429 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:57.279862 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.341815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:57.353108 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d7395b34-81ce-44b4-beda-7e3cf1922e92 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 1.064224 Oct 29 13:32:57.353701 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 41/79] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:56 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:32:57.362020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-f716ddfa-c01d-485b-97b5-b2f3970b001b req-f2c33005-9ae1-4128-8103-f8978b369326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3514ebdc-efef-4212-a080-cb9e0f9c7cc4", "tag": "297f0860-5eca-4489-80dd-06a64c0f02df"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:57.363573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:32:57.363573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:32:57.391154 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-f716ddfa-c01d-485b-97b5-b2f3970b001b req-f2c33005-9ae1-4128-8103-f8978b369326 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:57.392052 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-f716ddfa-c01d-485b-97b5-b2f3970b001b req-f2c33005-9ae1-4128-8103-f8978b369326 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.428740 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-f716ddfa-c01d-485b-97b5-b2f3970b001b req-f2c33005-9ae1-4128-8103-f8978b369326 service nova] Creating event network-changed:297f0860-5eca-4489-80dd-06a64c0f02df for instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 on hv-cinder-81588 Oct 29 13:32:57.450273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-f716ddfa-c01d-485b-97b5-b2f3970b001b req-f2c33005-9ae1-4128-8103-f8978b369326 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089131 Oct 29 13:32:57.456929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 42/80] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:32:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:32:57.469760 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:57.472888 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:57.485470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:57.489445 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.492751 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:57.493709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:57.654116 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:57.667456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-026153c4-7cb5-472d-9be7-25dcd464884f tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1501 microversion: 2.1 time: 0.415994 Oct 29 13:32:57.682066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 39/81] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:57 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1501 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:57.957049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:57.991109 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-eab193ac-64a5-4c91-b7ca-a53a59c56879 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1317 microversion: 2.1 time: 0.530461 Oct 29 13:32:57.992839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 43/82] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:57 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:58.034492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:58.035455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:58.043195 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:58.044318 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:58.046278 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:58.046957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:58.265814 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:58.266759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:58.276468 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:58.277157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:58.279325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:58.281690 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:58.557258 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:58.572319 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:58.574760 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:58.576283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e87d0070-97aa-44c5-8a50-06a597249b57 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1339 microversion: 2.20 time: 0.315280 Oct 29 13:32:58.578819 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 44/83] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:32:58 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1339 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:32:58.587815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:58.588411 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:58.603886 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:58.604686 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:58.606023 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:58.606652 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:58.826523 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:58.834811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c3a18398-a6f0-4677-bb31-778144638c75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.804883 Oct 29 13:32:58.835385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 40/84] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:58 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:59.008606 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:59.009534 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:59.020949 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:59.021896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:59.023199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:59.023986 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:59.075349 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:59.083281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-821d3c9e-4ac5-4d86-aaf1-bdd78eff7512 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 0.503777 Oct 29 13:32:59.099223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 45/85] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:58 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:59.421674 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:32:59.431481 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-710ed0f9-7096-4286-8acf-982fe7ed6e33 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1507 microversion: 2.1 time: 0.426897 Oct 29 13:32:59.435279 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 41/86] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:32:59 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1507 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:32:59.439878 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6ccb90c7-1730-4ff5-8582-01e14c06ae3b tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a48ccffe-b7ef-4294-b256-adb3d863d615"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:59.440921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6ccb90c7-1730-4ff5-8582-01e14c06ae3b tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:59.453232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ccb90c7-1730-4ff5-8582-01e14c06ae3b tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:59.457343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ccb90c7-1730-4ff5-8582-01e14c06ae3b tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:59.458483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ccb90c7-1730-4ff5-8582-01e14c06ae3b tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:59.458930 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ccb90c7-1730-4ff5-8582-01e14c06ae3b tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:59.545654 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-80827b14-5d60-44f1-9c43-8eb96be23369 req-7ed07a4d-5da1-4fb1-b9ac-2b75db4781c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb48a55c-da01-4b05-845f-ee4e65716b31", "tag": "4772a4e2-ffbd-436d-be0b-c8b0d53b4648"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:32:59.547781 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:32:59.547781 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:32:59.564095 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-80827b14-5d60-44f1-9c43-8eb96be23369 req-7ed07a4d-5da1-4fb1-b9ac-2b75db4781c6 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:59.564841 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-80827b14-5d60-44f1-9c43-8eb96be23369 req-7ed07a4d-5da1-4fb1-b9ac-2b75db4781c6 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:59.585457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-80827b14-5d60-44f1-9c43-8eb96be23369 req-7ed07a4d-5da1-4fb1-b9ac-2b75db4781c6 service nova] Creating event network-changed:4772a4e2-ffbd-436d-be0b-c8b0d53b4648 for instance eb48a55c-da01-4b05-845f-ee4e65716b31 on hv-cinder-81588 Oct 29 13:32:59.609742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-80827b14-5d60-44f1-9c43-8eb96be23369 req-7ed07a4d-5da1-4fb1-b9ac-2b75db4781c6 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068209 Oct 29 13:32:59.610970 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 42/87] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:32:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:32:59.628166 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:32:59.629226 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:32:59.638590 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:59.639358 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:32:59.640437 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:32:59.641107 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:00.267463 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6ccb90c7-1730-4ff5-8582-01e14c06ae3b tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "POST /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831028 Oct 29 13:33:00.269229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 46/88] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:32:59 2021] POST /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:00.283521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:00.290695 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:00.311176 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:00.316228 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:00.317414 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:00.321546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:00.349508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:00.364005 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:00.368897 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:00.374772 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-12c37f36-26d2-4e16-b727-fe12125126c8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.760584 Oct 29 13:33:00.376935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 43/89] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:32:59 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:00.386095 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-245c6ffd-e908-4175-8c85-094430564e86 req-17c37146-d055-4464-bd99-1bea837660da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36bbf99-9c28-4d21-b72b-a31707096ce3", "name": "network-vif-plugged", "status": "completed", "tag": "e4e2d45b-c9a5-4290-bade-10c339385ea2"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:00.387774 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:00.387774 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:00.410479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-245c6ffd-e908-4175-8c85-094430564e86 req-17c37146-d055-4464-bd99-1bea837660da service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:00.410962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-245c6ffd-e908-4175-8c85-094430564e86 req-17c37146-d055-4464-bd99-1bea837660da service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:00.440854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-245c6ffd-e908-4175-8c85-094430564e86 req-17c37146-d055-4464-bd99-1bea837660da service nova] Creating event network-vif-plugged:e4e2d45b-c9a5-4290-bade-10c339385ea2 for instance e36bbf99-9c28-4d21-b72b-a31707096ce3 on hv-cinder-81588 Oct 29 13:33:00.446838 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-245c6ffd-e908-4175-8c85-094430564e86 req-17c37146-d055-4464-bd99-1bea837660da service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069437 Oct 29 13:33:00.447784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 44/90] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:00.457205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:00.457948 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:00.468015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:00.469022 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:00.469633 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:00.470779 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:00.839459 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:00.854054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:00.857281 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c20cad67-5c46-4e70-a7e7-7e25ec69865d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 0.407025 Oct 29 13:33:00.858763 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 45/91] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:00 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:00.863626 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b3d54408-6370-489a-b2a5-495ad0a94200 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.588108 Oct 29 13:33:00.864322 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 47/92] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:00 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:00.865906 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-8eaf9253-4ea2-40f2-bb00-841e3b0731de req-8cbd247a-e382-43ec-8049-577e69ab869c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c9284f-a335-4a48-9c8b-5e1572d12240", "tag": "d49765ad-79cc-45ce-898a-88b1395fa0fb"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:00.868805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:00.868805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:00.880261 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-8eaf9253-4ea2-40f2-bb00-841e3b0731de req-8cbd247a-e382-43ec-8049-577e69ab869c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:00.880939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-8eaf9253-4ea2-40f2-bb00-841e3b0731de req-8cbd247a-e382-43ec-8049-577e69ab869c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:00.903230 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-8eaf9253-4ea2-40f2-bb00-841e3b0731de req-8cbd247a-e382-43ec-8049-577e69ab869c service nova] Creating event network-changed:d49765ad-79cc-45ce-898a-88b1395fa0fb for instance 27c9284f-a335-4a48-9c8b-5e1572d12240 on hv-cinder-81588 Oct 29 13:33:00.912426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-8eaf9253-4ea2-40f2-bb00-841e3b0731de req-8cbd247a-e382-43ec-8049-577e69ab869c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052082 Oct 29 13:33:00.913024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 46/93] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:01.079131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-104264cc-7ac6-4281-ad5d-f4b86d1f9b01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c588e64-68dc-492f-87a2-7c609caca9fa"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:01.080360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-104264cc-7ac6-4281-ad5d-f4b86d1f9b01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:01.086983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-104264cc-7ac6-4281-ad5d-f4b86d1f9b01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.087655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-104264cc-7ac6-4281-ad5d-f4b86d1f9b01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:01.088421 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-104264cc-7ac6-4281-ad5d-f4b86d1f9b01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.089174 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-104264cc-7ac6-4281-ad5d-f4b86d1f9b01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:01.397661 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:01.398379 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:01.410525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.411679 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:01.412610 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.415870 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:01.420215 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-104264cc-7ac6-4281-ad5d-f4b86d1f9b01 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342584 Oct 29 13:33:01.426382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 48/94] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:33:01 2021] POST /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:01.785849 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:01.817646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:01.819168 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:01.820295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5f721923-f16c-42d6-abc1-56b9cadee77b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.429685 Oct 29 13:33:01.822353 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 47/95] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:01 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:01.875398 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:01.876755 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:01.884509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.884695 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:01.885267 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:01.898689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:01.900414 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.902183 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.902665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:01.903027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:01.903808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:01.907008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:02.157581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:02.186732 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f26476e8-f7b9-4c5b-b542-91d819b67ef5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 0.315945 Oct 29 13:33:02.187536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 49/96] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:01 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:02.197045 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:02.204457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-32762e7a-ea0a-4850-8ec7-e7c049e9b2af tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.324286 Oct 29 13:33:02.206426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 48/97] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:01 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:02.840312 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:02.841455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:02.848141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:02.848592 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:02.849392 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:02.850080 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:02.990739 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:02.999375 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:03.000873 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:03.002023 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5dd382fc-7e48-4030-b0da-de6fb446b7ec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.166888 Oct 29 13:33:03.005803 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 50/98] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:02 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:03.204156 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:03.204768 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:03.211909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:03.212870 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:03.225080 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:03.225934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:03.233362 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:03.233537 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:03.234174 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:03.236400 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:03.237389 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:03.239856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:03.384387 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:03.392588 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-bf86e1f1-e4ea-4b46-93ac-5a07c70b02db tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.172336 Oct 29 13:33:03.393689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 51/99] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:03 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:03.457971 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:03.481090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f581c198-ccdd-4782-a964-2f20211987f9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 0.278749 Oct 29 13:33:03.481696 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 49/100] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:03 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:03.802390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-fabc6d0d-6a0b-44be-9dfc-742a370dbca6 req-60906481-ca2f-4d9c-a2e7-013fa58e042d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3514ebdc-efef-4212-a080-cb9e0f9c7cc4", "name": "network-vif-plugged", "status": "completed", "tag": "297f0860-5eca-4489-80dd-06a64c0f02df"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:03.804442 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:03.804442 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:33:03.815689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-fabc6d0d-6a0b-44be-9dfc-742a370dbca6 req-60906481-ca2f-4d9c-a2e7-013fa58e042d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:03.816692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-fabc6d0d-6a0b-44be-9dfc-742a370dbca6 req-60906481-ca2f-4d9c-a2e7-013fa58e042d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:03.831752 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-fabc6d0d-6a0b-44be-9dfc-742a370dbca6 req-60906481-ca2f-4d9c-a2e7-013fa58e042d service nova] Creating event network-vif-plugged:297f0860-5eca-4489-80dd-06a64c0f02df for instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 on hv-cinder-81588 Oct 29 13:33:03.837475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-fabc6d0d-6a0b-44be-9dfc-742a370dbca6 req-60906481-ca2f-4d9c-a2e7-013fa58e042d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039723 Oct 29 13:33:03.838365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 52/101] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:04.019540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:04.020224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:04.030905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:04.031595 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:04.032585 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:04.033026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:04.268588 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:04.279415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:04.281205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:04.282550 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9646069c-3913-4bbe-81ce-961351e06d1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.267010 Oct 29 13:33:04.300064 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 50/102] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:04 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:04.411702 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:04.412413 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:04.423296 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:04.423760 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:04.424588 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:04.425526 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:04.497361 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:04.498259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:04.507896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:04.509275 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:04.513343 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:04.514070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:04.601900 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:04.609724 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-30683099-7e18-4b71-9810-2fea6d0ae37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.203560 Oct 29 13:33:04.610318 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 53/103] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:04 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:04.684916 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:04.693462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e04549b2-4b67-4b21-8cf8-fc50571c645f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 0.199541 Oct 29 13:33:04.694425 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 51/104] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:04 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:05.305180 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:05.305180 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:05.307762 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:05.308000 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:05.309297 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:05.309732 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:05.436280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:05.454884 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:05.456338 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:05.457482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cb23a9f2-7455-4a3f-b4c5-2cb5f97bdb4d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.160871 Oct 29 13:33:05.458796 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 54/105] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:05 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:05.627518 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:05.628128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:05.635760 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:05.637047 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:05.637863 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:05.638304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:05.712279 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:05.713230 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:05.723423 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:05.729261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:05.730121 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:05.731901 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:05.842907 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:05.852411 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1c0952fc-49a4-4238-9a24-10d3556eb12b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1360 microversion: 2.1 time: 0.228234 Oct 29 13:33:05.855160 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 52/106] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:05 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1360 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:05.889115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-e0c92cd4-21bb-49c8-972d-6ffd067f7e24 req-3ffd36e5-9409-4511-a0e0-4170fc0e8aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb48a55c-da01-4b05-845f-ee4e65716b31", "name": "network-vif-plugged", "status": "completed", "tag": "4772a4e2-ffbd-436d-be0b-c8b0d53b4648"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:05.892057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:05.892057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:05.904615 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e0c92cd4-21bb-49c8-972d-6ffd067f7e24 req-3ffd36e5-9409-4511-a0e0-4170fc0e8aaa service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:05.905482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e0c92cd4-21bb-49c8-972d-6ffd067f7e24 req-3ffd36e5-9409-4511-a0e0-4170fc0e8aaa service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:05.921516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-e0c92cd4-21bb-49c8-972d-6ffd067f7e24 req-3ffd36e5-9409-4511-a0e0-4170fc0e8aaa service nova] Creating event network-vif-plugged:4772a4e2-ffbd-436d-be0b-c8b0d53b4648 for instance eb48a55c-da01-4b05-845f-ee4e65716b31 on hv-cinder-81588 Oct 29 13:33:05.927895 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-e0c92cd4-21bb-49c8-972d-6ffd067f7e24 req-3ffd36e5-9409-4511-a0e0-4170fc0e8aaa service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045167 Oct 29 13:33:05.929179 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 53/107] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:05.996354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:06.005371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5d0acc99-5c77-4861-907b-f06facb4f364 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 0.297007 Oct 29 13:33:06.006210 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 55/108] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:05 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:06.477846 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:06.478551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:06.486072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:06.486516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:06.487280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:06.487714 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:06.617352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:06.625492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:06.627055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:06.628483 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5a2a30e9-b5cb-4ce0-b74b-e1415cc184f0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.155618 Oct 29 13:33:06.639253 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 54/109] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:06 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:06.871734 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:06.872348 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:06.878356 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:06.878813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:06.879578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:06.880010 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.022189 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:07.023370 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:07.045689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:07.048784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:07.049735 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.051648 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:07.052178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.055265 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-154f893b-286a-4918-9cef-033c6de2ab13 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1546 microversion: 2.1 time: 0.186959 Oct 29 13:33:07.056214 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 56/110] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:06 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1546 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:07.073489 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7459b9e7-761b-4df4-bc36-ebeb34c685c4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:07.074057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7459b9e7-761b-4df4-bc36-ebeb34c685c4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:07.086602 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7459b9e7-761b-4df4-bc36-ebeb34c685c4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:07.086956 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7459b9e7-761b-4df4-bc36-ebeb34c685c4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.087744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7459b9e7-761b-4df4-bc36-ebeb34c685c4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:07.088343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7459b9e7-761b-4df4-bc36-ebeb34c685c4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.202633 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7459b9e7-761b-4df4-bc36-ebeb34c685c4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134201 Oct 29 13:33:07.203232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 57/111] 10.222.0.96 () {58 vars in 1274 bytes} [Fri Oct 29 13:33:07 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:07.211127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:07.220526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f31c934e-8d39-4803-98db-0038c9b95857 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1320 microversion: 2.1 time: 0.201474 Oct 29 13:33:07.221650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 55/112] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:07 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:07.646839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:07.647439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:07.656536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:07.658083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.660510 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:07.662971 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.951384 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-d3c07840-08e0-4072-8d12-5dfba6ea16d0 req-985ff1ce-7554-42a1-9c04-8c13f261a7fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c9284f-a335-4a48-9c8b-5e1572d12240", "name": "network-vif-plugged", "status": "completed", "tag": "d49765ad-79cc-45ce-898a-88b1395fa0fb"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:07.952939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:07.952939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:07.965952 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-d3c07840-08e0-4072-8d12-5dfba6ea16d0 req-985ff1ce-7554-42a1-9c04-8c13f261a7fe service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:07.966493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-d3c07840-08e0-4072-8d12-5dfba6ea16d0 req-985ff1ce-7554-42a1-9c04-8c13f261a7fe service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:07.978080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-d3c07840-08e0-4072-8d12-5dfba6ea16d0 req-985ff1ce-7554-42a1-9c04-8c13f261a7fe service nova] Creating event network-vif-plugged:d49765ad-79cc-45ce-898a-88b1395fa0fb for instance 27c9284f-a335-4a48-9c8b-5e1572d12240 on hv-cinder-81588 Oct 29 13:33:07.983967 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-d3c07840-08e0-4072-8d12-5dfba6ea16d0 req-985ff1ce-7554-42a1-9c04-8c13f261a7fe service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036777 Oct 29 13:33:07.985104 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 56/113] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:08.181397 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:08.190297 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:08.192437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:08.193738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3572ccde-88b9-4c3b-8258-33e814c3d32e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.550387 Oct 29 13:33:08.194799 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 58/114] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:07 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:08.238647 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:08.239576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:08.245830 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.247006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:08.248261 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.249048 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:08.441383 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:08.452897 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ba48dcb0-ab5f-40f4-99a7-d6e6b307bcb6 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1515 microversion: 2.1 time: 0.218143 Oct 29 13:33:08.454579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 57/115] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:08 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:08.471333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:08.472325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:08.481126 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.481755 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:08.483213 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.483795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:08.513179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lazy-loading 'flavor' on Instance uuid eb48a55c-da01-4b05-845f-ee4e65716b31 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:33:08.658822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-acfd5dfe-2bb7-42ff-bb64-3b9e8176fa84 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31/action" status: 200 len: 32 microversion: 2.1 time: 0.191208 Oct 29 13:33:08.660106 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 59/116] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:08 2021] POST /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31/action => generated 32 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:08.669605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:08.671082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:08.678446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.679095 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:08.680689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.681614 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:08.953115 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9ddd3449-230c-45cb-89d1-cb10f9ebc7cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:08.954141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9ddd3449-230c-45cb-89d1-cb10f9ebc7cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:08.961106 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ddd3449-230c-45cb-89d1-cb10f9ebc7cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.961893 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ddd3449-230c-45cb-89d1-cb10f9ebc7cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:08.962883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ddd3449-230c-45cb-89d1-cb10f9ebc7cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:08.963852 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ddd3449-230c-45cb-89d1-cb10f9ebc7cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:09.024227 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:09.036185 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-173fb677-89ea-4749-916b-4fa06c03f067 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.370799 Oct 29 13:33:09.039312 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 58/117] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:08 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:09.044733 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-388c218a-562b-4c25-955e-90ac9196eb2b req-f2550a4d-6e01-4cef-8a35-935c11acf4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3514ebdc-efef-4212-a080-cb9e0f9c7cc4", "tag": "297f0860-5eca-4489-80dd-06a64c0f02df"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:09.053724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:09.053724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:09.065824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-388c218a-562b-4c25-955e-90ac9196eb2b req-f2550a4d-6e01-4cef-8a35-935c11acf4b9 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:09.069030 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-388c218a-562b-4c25-955e-90ac9196eb2b req-f2550a4d-6e01-4cef-8a35-935c11acf4b9 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:09.082715 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-388c218a-562b-4c25-955e-90ac9196eb2b req-f2550a4d-6e01-4cef-8a35-935c11acf4b9 service nova] Creating event network-changed:297f0860-5eca-4489-80dd-06a64c0f02df for instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 on hv-cinder-81588 Oct 29 13:33:09.088330 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-388c218a-562b-4c25-955e-90ac9196eb2b req-f2550a4d-6e01-4cef-8a35-935c11acf4b9 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046945 Oct 29 13:33:09.089214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 59/118] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:09.115664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9ddd3449-230c-45cb-89d1-cb10f9ebc7cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.167109 Oct 29 13:33:09.119650 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 60/119] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:08 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:33:09.215922 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:09.217152 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:09.227069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:09.228081 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:09.240716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:09.241362 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:09.720661 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:09.743608 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:09.752427 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:09.756474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e486fc64-da4f-4a18-b511-5932ef0ad568 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1407 microversion: 2.20 time: 0.546934 Oct 29 13:33:09.769138 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 60/120] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:09 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1407 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:10.055751 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:10.057086 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:10.064973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.066948 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.067964 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.069155 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.137798 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f551fbfe-4964-4adc-a14b-416784d93a72 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:10.141399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f551fbfe-4964-4adc-a14b-416784d93a72 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:10.161228 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f551fbfe-4964-4adc-a14b-416784d93a72 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.163410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f551fbfe-4964-4adc-a14b-416784d93a72 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.164301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f551fbfe-4964-4adc-a14b-416784d93a72 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.165312 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f551fbfe-4964-4adc-a14b-416784d93a72 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.419227 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f551fbfe-4964-4adc-a14b-416784d93a72 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.294286 Oct 29 13:33:10.420074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 61/121] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:10 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:10.433349 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:10.447993 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a3822f26-b60f-4d98-ab99-0ab4c5efe7a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.394945 Oct 29 13:33:10.457586 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 61/122] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:10 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:10.576568 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:10.577180 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:10.585787 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.586511 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.587441 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.588073 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.619245 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:33:10.762407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f92b1862-f645-41ba-a7eb-6980497a36ed tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 204 len: 0 microversion: 2.1 time: 0.189950 Oct 29 13:33:10.763091 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 62/123] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:33:10 2021] DELETE /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:33:10.771388 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:10.772347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:10.779089 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.779765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.780666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.781220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.788433 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:10.789186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:10.799033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.799503 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.800297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:10.800730 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:10.986781 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:11.008291 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d887d13b-10c5-40ae-a5ad-b1226d5ee401 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1553 microversion: 2.1 time: 0.240610 Oct 29 13:33:11.009381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 62/124] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:10 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1553 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:11.024790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:11.034807 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:11.036621 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:11.038048 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6a46b564-bc87-432e-8616-0e3bb40c9e3d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1600 microversion: 2.20 time: 0.254300 Oct 29 13:33:11.038531 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 63/125] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:33:10 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1600 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:33:11.058737 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6fc517e3-158c-4d45-b625-d1504e6300df tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:11.063035 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6fc517e3-158c-4d45-b625-d1504e6300df tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:11.069986 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6fc517e3-158c-4d45-b625-d1504e6300df tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:11.070433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6fc517e3-158c-4d45-b625-d1504e6300df tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:11.071561 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6fc517e3-158c-4d45-b625-d1504e6300df tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:11.072000 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6fc517e3-158c-4d45-b625-d1504e6300df tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:11.174533 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6fc517e3-158c-4d45-b625-d1504e6300df tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122118 Oct 29 13:33:11.175346 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 63/126] 10.222.0.96 () {60 vars in 1315 bytes} [Fri Oct 29 13:33:11 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:33:11.430488 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6bd873a2-a6df-42b2-8b98-e6594cbc0f20 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:11.432004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6bd873a2-a6df-42b2-8b98-e6594cbc0f20 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:11.443143 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6bd873a2-a6df-42b2-8b98-e6594cbc0f20 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:11.443601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6bd873a2-a6df-42b2-8b98-e6594cbc0f20 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:11.447700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6bd873a2-a6df-42b2-8b98-e6594cbc0f20 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:11.448202 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6bd873a2-a6df-42b2-8b98-e6594cbc0f20 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:11.464730 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:11.465341 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:11.474978 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:11.476665 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:11.478649 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:11.480131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:11.571188 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6bd873a2-a6df-42b2-8b98-e6594cbc0f20 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.144090 Oct 29 13:33:11.572004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 64/127] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:11 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:11.654926 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:11.662398 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-615d8dfd-57dc-46f9-8a3a-be57c1c9ca26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.201370 Oct 29 13:33:11.673046 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 64/128] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:11 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:12.027564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:12.028265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:12.045144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.045144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.045144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.045144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.372396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:12.387725 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-066b6f4b-b98d-463d-b034-f0ce64a60d1e tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1553 microversion: 2.1 time: 0.364799 Oct 29 13:33:12.388631 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 65/129] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:12 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1553 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:12.582779 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-909bc2ea-250a-498a-9e91-c5e7159e2090 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:12.584536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-909bc2ea-250a-498a-9e91-c5e7159e2090 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:12.591690 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-909bc2ea-250a-498a-9e91-c5e7159e2090 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.592348 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-909bc2ea-250a-498a-9e91-c5e7159e2090 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.602166 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-909bc2ea-250a-498a-9e91-c5e7159e2090 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.602856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-909bc2ea-250a-498a-9e91-c5e7159e2090 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.680836 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:12.681646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:12.687800 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-909bc2ea-250a-498a-9e91-c5e7159e2090 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.109893 Oct 29 13:33:12.691306 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 65/130] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:12 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:12.691761 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.691761 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.691761 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.693251 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.918102 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6d20b205-f37f-4811-88e2-b05b1e390ba6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:12.919121 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6d20b205-f37f-4811-88e2-b05b1e390ba6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:12.924709 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:12.930309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d20b205-f37f-4811-88e2-b05b1e390ba6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.930761 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d20b205-f37f-4811-88e2-b05b1e390ba6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.931540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d20b205-f37f-4811-88e2-b05b1e390ba6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.931972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d20b205-f37f-4811-88e2-b05b1e390ba6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.933726 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-611a326e-68e9-4c3b-86e1-bfacec4e9ff8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.256431 Oct 29 13:33:12.935793 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 66/131] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:12 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:12.947254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-0c2e493a-eb11-4ed8-8f4e-8e7090cf8aa5 req-d21c48cc-92a0-4321-8279-bd774814358f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c9284f-a335-4a48-9c8b-5e1572d12240", "tag": "d49765ad-79cc-45ce-898a-88b1395fa0fb"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:12.953175 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:12.953175 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:12.965103 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0c2e493a-eb11-4ed8-8f4e-8e7090cf8aa5 req-d21c48cc-92a0-4321-8279-bd774814358f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:12.965650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0c2e493a-eb11-4ed8-8f4e-8e7090cf8aa5 req-d21c48cc-92a0-4321-8279-bd774814358f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:12.980922 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-0c2e493a-eb11-4ed8-8f4e-8e7090cf8aa5 req-d21c48cc-92a0-4321-8279-bd774814358f service nova] Creating event network-changed:d49765ad-79cc-45ce-898a-88b1395fa0fb for instance 27c9284f-a335-4a48-9c8b-5e1572d12240 on hv-cinder-81588 Oct 29 13:33:12.991570 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-0c2e493a-eb11-4ed8-8f4e-8e7090cf8aa5 req-d21c48cc-92a0-4321-8279-bd774814358f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053492 Oct 29 13:33:12.992427 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 67/132] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:13.066082 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6d20b205-f37f-4811-88e2-b05b1e390ba6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.152801 Oct 29 13:33:13.066725 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 66/133] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:12 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:13.405977 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:13.406712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:13.421117 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:13.421566 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:13.422385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:13.422825 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:13.701003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a0f9c19e-0957-4ae4-894d-1e6f90460242 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:13.702353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a0f9c19e-0957-4ae4-894d-1e6f90460242 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:13.716465 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0f9c19e-0957-4ae4-894d-1e6f90460242 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:13.717842 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0f9c19e-0957-4ae4-894d-1e6f90460242 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:13.718662 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0f9c19e-0957-4ae4-894d-1e6f90460242 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:13.721309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0f9c19e-0957-4ae4-894d-1e6f90460242 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:13.807087 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:13.816379 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-94c3ed4d-c0be-46b7-a190-67a7ee97bf0c tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1553 microversion: 2.1 time: 0.414890 Oct 29 13:33:13.817206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 68/134] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:13 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1553 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:13.822742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-3ecb8546-f7c5-4264-8b72-af39d4ef0d09 req-4d6daf6b-9015-4e71-a4d2-c9afd7af5a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9697ec88-0207-4a75-9f13-334453021731", "name": "network-vif-deleted", "tag": "2f64a540-a793-4305-9ee9-6fe3b62e1388"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:13.824484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:13.824484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:13.831663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-3ecb8546-f7c5-4264-8b72-af39d4ef0d09 req-4d6daf6b-9015-4e71-a4d2-c9afd7af5a1c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:13.832292 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-3ecb8546-f7c5-4264-8b72-af39d4ef0d09 req-4d6daf6b-9015-4e71-a4d2-c9afd7af5a1c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:13.834992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a0f9c19e-0957-4ae4-894d-1e6f90460242 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.139225 Oct 29 13:33:13.836440 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 67/135] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:13 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:13.844204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-3ecb8546-f7c5-4264-8b72-af39d4ef0d09 req-4d6daf6b-9015-4e71-a4d2-c9afd7af5a1c service nova] Creating event network-vif-deleted:2f64a540-a793-4305-9ee9-6fe3b62e1388 for instance 9697ec88-0207-4a75-9f13-334453021731 on hv-cinder-81588 Oct 29 13:33:13.851373 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-3ecb8546-f7c5-4264-8b72-af39d4ef0d09 req-4d6daf6b-9015-4e71-a4d2-c9afd7af5a1c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032436 Oct 29 13:33:13.854414 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 69/136] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:13.953156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:13.953830 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:13.961044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:13.962042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:13.963005 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:13.963601 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:14.079193 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8402cfc8-9b86-4d5b-8d5d-364c6ad9b859 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:14.080262 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8402cfc8-9b86-4d5b-8d5d-364c6ad9b859 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:14.091879 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8402cfc8-9b86-4d5b-8d5d-364c6ad9b859 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:14.095418 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8402cfc8-9b86-4d5b-8d5d-364c6ad9b859 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:14.097324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8402cfc8-9b86-4d5b-8d5d-364c6ad9b859 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:14.097806 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8402cfc8-9b86-4d5b-8d5d-364c6ad9b859 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:14.138688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:14.146826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-086471b7-7065-4f5a-b7cd-833d0725fce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.198810 Oct 29 13:33:14.147716 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 68/137] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:13 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:14.172545 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8402cfc8-9b86-4d5b-8d5d-364c6ad9b859 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.098611 Oct 29 13:33:14.176193 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 70/138] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:14 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:14.656683 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1068782835", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "641c12dc-e9e2-4861-b839-f7d1974ae0f8"}]}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:14.713678 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] validate_networks() for [('641c12dc-e9e2-4861-b839-f7d1974ae0f8', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:33:14.835365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:14.836828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:14.844801 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:14.845568 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:14.846754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:14.847415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:14.893964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:14.894389 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:14.894989 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lazy-loading 'fault' on Instance uuid 9697ec88-0207-4a75-9f13-334453021731 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:33:14.976798 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c9639d40a9f4cac946ff358215d9d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14990b53311b47f3839dcf8442e0b79e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:14.988594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fa91ecf9-9d85-4d0c-abfa-313da1dbc8fd tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 200 len: 1304 microversion: 2.1 time: 0.156456 Oct 29 13:33:14.989529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 71/139] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:14 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:14.996932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-73f43ad0-f3a8-451c-949d-f37785f7c79a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:14.999438 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-73f43ad0-f3a8-451c-949d-f37785f7c79a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:15.005886 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73f43ad0-f3a8-451c-949d-f37785f7c79a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.006943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73f43ad0-f3a8-451c-949d-f37785f7c79a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.008516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73f43ad0-f3a8-451c-949d-f37785f7c79a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.009100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73f43ad0-f3a8-451c-949d-f37785f7c79a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.090258 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-73f43ad0-f3a8-451c-949d-f37785f7c79a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.097589 Oct 29 13:33:15.090258 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 72/140] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:14 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:15.164754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:15.165570 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:15.172790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.174111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.174902 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.175336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.206979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:33:15.207570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:33:15.208214 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:33:15.208753 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:33:15.209360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:33:15.222542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.222993 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.223787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.224404 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.242068 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Getting quotas for project f3eb52fe6377419f9b2d3781809c21c5. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:33:15.246684 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Getting quotas for user d3cf89ee80644cb5828017fccc19186d and project f3eb52fe6377419f9b2d3781809c21c5. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:33:15.258900 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:33:15.261540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:33:15.328281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a80ee69e-0ecd-48f4-92c1-cf141db3f118 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676056 Oct 29 13:33:15.328916 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 69/141] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:33:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:33:15.334119 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-00ab1465-c050-4cb8-bc08-e5eeba3facec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:15.335387 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-00ab1465-c050-4cb8-bc08-e5eeba3facec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:15.343902 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00ab1465-c050-4cb8-bc08-e5eeba3facec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.344401 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00ab1465-c050-4cb8-bc08-e5eeba3facec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.345186 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00ab1465-c050-4cb8-bc08-e5eeba3facec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:15.345657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00ab1465-c050-4cb8-bc08-e5eeba3facec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:15.375520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:15.384073 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-62a09f0a-d6fb-4140-8555-dfff6d22e842 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.223517 Oct 29 13:33:15.386228 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 73/142] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:15 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:15.393831 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8ac2abbf-4a3b-4fc5-b60e-e28c03125112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:15.393831 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8ac2abbf-4a3b-4fc5-b60e-e28c03125112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:15.463285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8ac2abbf-4a3b-4fc5-b60e-e28c03125112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:15.463800 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-00ab1465-c050-4cb8-bc08-e5eeba3facec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.133170 Oct 29 13:33:15.465483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 70/143] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:15 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:15.473019 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8ac2abbf-4a3b-4fc5-b60e-e28c03125112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1219 microversion: 2.1 time: 0.085264 Oct 29 13:33:15.477041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 74/144] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:15 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:16.007884 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:16.009242 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:16.018354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.019490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.020551 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.021408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.037483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] HTTP exception thrown: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. Oct 29 13:33:16.038491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Returning 404 to user: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:16.039737 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2ad298cb-12d1-461e-b72e-2976fda6762d tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 404 len: 111 microversion: 2.1 time: 0.036528 Oct 29 13:33:16.040497 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 71/145] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:16 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:33:16.100743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-37bdb2da-794e-456c-84f3-4ca219b545fa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:16.102423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-37bdb2da-794e-456c-84f3-4ca219b545fa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:16.110068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37bdb2da-794e-456c-84f3-4ca219b545fa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.110851 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37bdb2da-794e-456c-84f3-4ca219b545fa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.112090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37bdb2da-794e-456c-84f3-4ca219b545fa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.112709 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37bdb2da-794e-456c-84f3-4ca219b545fa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.217485 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-37bdb2da-794e-456c-84f3-4ca219b545fa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.120490 Oct 29 13:33:16.221269 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 75/146] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:16 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:16.256204 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:16.257685 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:16.267458 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.268042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.269031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.269501 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.292208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] HTTP exception thrown: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. Oct 29 13:33:16.294185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Returning 404 to user: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:16.296020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ceabb02e-5bf0-4d12-88f2-22b0ea6c97df tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046287 Oct 29 13:33:16.297187 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 72/147] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:33:16 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731/os-volume_attachments => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:33:16.406206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:16.407479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:16.415732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.416192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.417872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.418600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.477349 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6f78dd3e-f122-40f0-ace9-a2ef7e43a1af tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:16.478701 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6f78dd3e-f122-40f0-ace9-a2ef7e43a1af tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:16.492655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f78dd3e-f122-40f0-ace9-a2ef7e43a1af tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.493212 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f78dd3e-f122-40f0-ace9-a2ef7e43a1af tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.510567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f78dd3e-f122-40f0-ace9-a2ef7e43a1af tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.511265 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f78dd3e-f122-40f0-ace9-a2ef7e43a1af tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.598552 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:16.605432 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6f78dd3e-f122-40f0-ace9-a2ef7e43a1af tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.132781 Oct 29 13:33:16.606385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 73/148] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:16 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:16.608343 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2dcf728e-3418-46c8-ba2e-a444e46ab711 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.208115 Oct 29 13:33:16.609176 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 76/149] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:16 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:16.619936 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:16.621112 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:16.630112 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.630644 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.631536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:16.632179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:16.701398 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:16.711741 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8d97c15b-27c5-4b77-9ef8-f8a3ddd6ba03 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1279 microversion: 2.1 time: 0.103927 Oct 29 13:33:16.712300 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 74/150] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:16 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1279 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:17.153915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-855804723", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "797a2d64-a318-481c-b064-119a76b4777f"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:17.206605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] validate_networks() for [('797a2d64-a318-481c-b064-119a76b4777f', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:33:17.228372 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5cb055f7-7254-4f26-a27c-d830388ddc94 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:17.229373 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5cb055f7-7254-4f26-a27c-d830388ddc94 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:17.235087 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5cb055f7-7254-4f26-a27c-d830388ddc94 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.235621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5cb055f7-7254-4f26-a27c-d830388ddc94 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.236452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5cb055f7-7254-4f26-a27c-d830388ddc94 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.236951 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5cb055f7-7254-4f26-a27c-d830388ddc94 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.321554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5cb055f7-7254-4f26-a27c-d830388ddc94 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.096729 Oct 29 13:33:17.322310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 75/151] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:17 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:33:17.537868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:17.538448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:17.545005 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.545626 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.546425 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.546857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.560873 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] HTTP exception thrown: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. Oct 29 13:33:17.561606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Returning 404 to user: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:17.562460 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ddca6cb9-e888-4946-8274-98252d496863 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 404 len: 111 microversion: 2.1 time: 0.028753 Oct 29 13:33:17.563026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 76/152] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:33:17 2021] DELETE /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:33:17.570479 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:17.571079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] [instance: 9697ec88-0207-4a75-9f13-334453021731] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:17.577135 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.577580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.578368 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.578799 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.591853 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] HTTP exception thrown: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. Oct 29 13:33:17.592429 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] Returning 404 to user: Instance 9697ec88-0207-4a75-9f13-334453021731 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:17.593234 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-843274c8-2878-4943-9697-d134e808bd42 tempest-DeleteServersTestJSON-1025600300 tempest-DeleteServersTestJSON-1025600300-project] 10.222.0.96 "GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731" status: 404 len: 111 microversion: 2.1 time: 0.026181 Oct 29 13:33:17.593754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 77/153] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:17 2021] GET /compute/v2.1/servers/9697ec88-0207-4a75-9f13-334453021731 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:33:17.616735 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1ee9f029-7e73-4fa0-b89b-672b087555bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:17.617643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1ee9f029-7e73-4fa0-b89b-672b087555bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:17.627184 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1ee9f029-7e73-4fa0-b89b-672b087555bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.627633 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1ee9f029-7e73-4fa0-b89b-672b087555bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.628840 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1ee9f029-7e73-4fa0-b89b-672b087555bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.629491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1ee9f029-7e73-4fa0-b89b-672b087555bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.700327 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1ee9f029-7e73-4fa0-b89b-672b087555bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.087288 Oct 29 13:33:17.703724 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 78/154] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:17 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:17.707230 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:17.707913 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:17.715147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.716059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.716896 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.717330 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.951512 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:17.959008 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-beda6f53-b613-40c1-92f2-c738eba4b1cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.256758 Oct 29 13:33:17.959858 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 79/155] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:17 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:17.973144 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:17.973995 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:17.980193 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.980628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:17.981580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:17.982380 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.081749 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:33:18.082379 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:33:18.082920 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:33:18.083327 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:33:18.083967 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:33:18.093958 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.094404 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.095198 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.095627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.113276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:33:18.117247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for user b827e16aad5a47d0bfeebfc3da8a94b9 and project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:33:18.137033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:33:18.139380 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:33:18.190428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a125d99d-c841-4a25-bb21-ec27f72fb819 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.040597 Oct 29 13:33:18.191336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 77/156] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:33:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:33:18.201644 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-26c7aad7-9d1a-4dcf-8673-7923d31fbdb0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:18.202343 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-26c7aad7-9d1a-4dcf-8673-7923d31fbdb0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:18.222548 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:18.231290 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-edb21819-42eb-4875-ab61-254419d73a31 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.270247 Oct 29 13:33:18.243955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 80/157] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:17 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:18.311854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-26c7aad7-9d1a-4dcf-8673-7923d31fbdb0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:18.318785 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-26c7aad7-9d1a-4dcf-8673-7923d31fbdb0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1217 microversion: 2.1 time: 0.121787 Oct 29 13:33:18.319454 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 78/158] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:18 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:18.332243 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dfd1da26-16d5-43fe-832b-dd49031b0f0d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:18.333146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dfd1da26-16d5-43fe-832b-dd49031b0f0d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:18.345408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dfd1da26-16d5-43fe-832b-dd49031b0f0d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.346089 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dfd1da26-16d5-43fe-832b-dd49031b0f0d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.347639 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dfd1da26-16d5-43fe-832b-dd49031b0f0d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.348352 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dfd1da26-16d5-43fe-832b-dd49031b0f0d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.462964 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dfd1da26-16d5-43fe-832b-dd49031b0f0d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.133959 Oct 29 13:33:18.466695 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 81/159] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:18 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:18.595592 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-05208380-3be2-4a0f-9602-ea5438c56ca6 req-39a3fb38-cccf-46e7-b31f-596ea71b56be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7faf1bee-b498-4510-a51e-b088632b19ed", "tag": "d544eccb-2834-4068-8fd9-568a5b3d26f1"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:18.597269 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:18.597269 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:18.613062 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-05208380-3be2-4a0f-9602-ea5438c56ca6 req-39a3fb38-cccf-46e7-b31f-596ea71b56be service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.613506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-05208380-3be2-4a0f-9602-ea5438c56ca6 req-39a3fb38-cccf-46e7-b31f-596ea71b56be service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.644333 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-05208380-3be2-4a0f-9602-ea5438c56ca6 req-39a3fb38-cccf-46e7-b31f-596ea71b56be service nova] Creating event network-changed:d544eccb-2834-4068-8fd9-568a5b3d26f1 for instance 7faf1bee-b498-4510-a51e-b088632b19ed on hv-cinder-81588 Oct 29 13:33:18.654772 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-05208380-3be2-4a0f-9602-ea5438c56ca6 req-39a3fb38-cccf-46e7-b31f-596ea71b56be service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066241 Oct 29 13:33:18.657578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 79/160] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:18.711839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-aa542a40-ede4-478f-a585-5d1bcdc60629 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:18.713231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-aa542a40-ede4-478f-a585-5d1bcdc60629 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:18.720505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa542a40-ede4-478f-a585-5d1bcdc60629 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.721171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa542a40-ede4-478f-a585-5d1bcdc60629 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.721963 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa542a40-ede4-478f-a585-5d1bcdc60629 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.722541 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa542a40-ede4-478f-a585-5d1bcdc60629 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.807142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-aa542a40-ede4-478f-a585-5d1bcdc60629 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.099122 Oct 29 13:33:18.808216 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 82/161] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:18 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:18.977415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:18.979080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:18.988193 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.988784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:18.989920 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:18.990614 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.145340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:19.153033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-34e07777-a5c3-423e-807d-8a0e25e1d3b9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.180397 Oct 29 13:33:19.153956 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 80/162] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:18 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:19.262797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:19.263662 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:19.270946 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.271475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.272347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.272851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.336722 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:19.338498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:19.347906 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.348759 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.349743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.350653 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.405860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:19.414137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8a93e0bd-4c5e-44fa-8b6f-01671932f81e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.155882 Oct 29 13:33:19.424111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 83/163] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:19 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:19.437026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:19.447663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2499a62f-712a-42d1-8878-b39d5316b471 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1269 microversion: 2.1 time: 0.114899 Oct 29 13:33:19.448402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 81/164] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:19 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1269 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:19.476949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-98b987b0-ac79-4144-8f99-c4ce7fe678b2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:19.478146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-98b987b0-ac79-4144-8f99-c4ce7fe678b2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:19.486047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98b987b0-ac79-4144-8f99-c4ce7fe678b2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.486684 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98b987b0-ac79-4144-8f99-c4ce7fe678b2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.487459 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98b987b0-ac79-4144-8f99-c4ce7fe678b2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.487885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98b987b0-ac79-4144-8f99-c4ce7fe678b2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.604808 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-98b987b0-ac79-4144-8f99-c4ce7fe678b2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.133710 Oct 29 13:33:19.605632 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 84/165] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:19 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:19.735986 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e4f8806c-818d-46c6-a01c-137eb676ecbd tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Action: 'create', calling method: .version_select at 0x7f547c42b940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1744302543"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:19.819096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-318d9118-f6b3-4f09-966d-46f14e7f1ab9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:19.820086 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-318d9118-f6b3-4f09-966d-46f14e7f1ab9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:19.826990 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318d9118-f6b3-4f09-966d-46f14e7f1ab9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.827425 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318d9118-f6b3-4f09-966d-46f14e7f1ab9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.828182 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318d9118-f6b3-4f09-966d-46f14e7f1ab9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:19.828607 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318d9118-f6b3-4f09-966d-46f14e7f1ab9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:19.911128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-318d9118-f6b3-4f09-966d-46f14e7f1ab9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.095982 Oct 29 13:33:19.914545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 85/166] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:19 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:20.085231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e4f8806c-818d-46c6-a01c-137eb676ecbd tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.489847 Oct 29 13:33:20.086335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 82/167] 10.222.0.96 () {60 vars in 1154 bytes} [Fri Oct 29 13:33:19 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 491 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 29 13:33:20.097962 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b96915b1-ac63-4d1e-83fc-cf7336bc0ad0 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c476c10>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:20.155276 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b96915b1-ac63-4d1e-83fc-cf7336bc0ad0 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd" status: 200 len: 345 microversion: 2.1 time: 0.061501 Oct 29 13:33:20.155801 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 86/168] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:20 2021] GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:20.175118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:20.177624 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:20.184530 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.185110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.186098 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.186696 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.334750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:20.342589 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c6da2bd9-baf3-405b-b896-f84eeaef2c26 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.171200 Oct 29 13:33:20.343340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 83/169] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:20 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:20.431795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:20.432744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:20.440414 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.440889 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.441948 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.442649 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.465613 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:20.466253 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:20.472366 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.472811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.473583 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.474037 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.592825 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:20.599980 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f8e559d0-5bc1-45c5-b55a-924b79a9e9c1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.138303 Oct 29 13:33:20.600856 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 84/170] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:20 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:20.615784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1561cf9e-ec5d-4631-b835-34c6c274ecd7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:20.617020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1561cf9e-ec5d-4631-b835-34c6c274ecd7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:20.623706 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1561cf9e-ec5d-4631-b835-34c6c274ecd7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.624155 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1561cf9e-ec5d-4631-b835-34c6c274ecd7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.624926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1561cf9e-ec5d-4631-b835-34c6c274ecd7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.625724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1561cf9e-ec5d-4631-b835-34c6c274ecd7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.658303 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:20.665518 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ac4959c8-54f2-44d8-800e-5bf85f0e3962 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.238029 Oct 29 13:33:20.666133 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 87/171] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:20 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:20.697603 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1561cf9e-ec5d-4631-b835-34c6c274ecd7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14 microversion: 2.1 time: 0.085238 Oct 29 13:33:20.700736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 85/172] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:20 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:33:20.922678 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ddd0dd00-a0c6-4e9a-b3ad-3f59d88e96ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:20.923640 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ddd0dd00-a0c6-4e9a-b3ad-3f59d88e96ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:20.929745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddd0dd00-a0c6-4e9a-b3ad-3f59d88e96ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.930289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddd0dd00-a0c6-4e9a-b3ad-3f59d88e96ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.931090 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddd0dd00-a0c6-4e9a-b3ad-3f59d88e96ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:20.931543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddd0dd00-a0c6-4e9a-b3ad-3f59d88e96ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:20.989551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-d70b5515-1ec9-4bc0-99cf-dd9069bed31e req-d0567c29-c3b2-4218-a1c8-16803105c565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2729e752-5a7b-4cc3-9ff3-0647ea7e7770", "tag": "d39096dc-56c6-4c48-95da-d069d4b1fb81"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:20.991053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:20.991053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:20.999604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-d70b5515-1ec9-4bc0-99cf-dd9069bed31e req-d0567c29-c3b2-4218-a1c8-16803105c565 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.000040 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-d70b5515-1ec9-4bc0-99cf-dd9069bed31e req-d0567c29-c3b2-4218-a1c8-16803105c565 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.007289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ddd0dd00-a0c6-4e9a-b3ad-3f59d88e96ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.088038 Oct 29 13:33:21.008739 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 88/173] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:20 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:21.019199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-d70b5515-1ec9-4bc0-99cf-dd9069bed31e req-d0567c29-c3b2-4218-a1c8-16803105c565 service nova] Creating event network-changed:d39096dc-56c6-4c48-95da-d069d4b1fb81 for instance 2729e752-5a7b-4cc3-9ff3-0647ea7e7770 on hv-cinder-81588 Oct 29 13:33:21.023772 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-d70b5515-1ec9-4bc0-99cf-dd9069bed31e req-d0567c29-c3b2-4218-a1c8-16803105c565 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038129 Oct 29 13:33:21.024445 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 86/174] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:21.179353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0a3a748e-f18f-4f06-adfc-b34d7bc96c25 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c48e280>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:21.248309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0a3a748e-f18f-4f06-adfc-b34d7bc96c25 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd" status: 200 len: 346 microversion: 2.1 time: 0.072712 Oct 29 13:33:21.251690 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 89/175] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:21 2021] GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:21.263468 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-79af9e1b-2b69-4cda-90f9-4e671ee6986f tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Action: 'create', calling method: .version_select at 0x7f547c458e50>, body: {"snapshot": {"volume_id": "693b27e7-131b-4bfb-bc53-731f7adda9fd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1145017243"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:21.361118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:21.361877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:21.370360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.371093 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.372439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.373162 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.456409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-79af9e1b-2b69-4cda-90f9-4e671ee6986f tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.196117 Oct 29 13:33:21.457999 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 87/176] 10.222.0.96 () {60 vars in 1161 bytes} [Fri Oct 29 13:33:21 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:21.468125 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5a632a20-547a-435e-a19c-6c3ba10ffdd4 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c5fbee0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:21.533762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5a632a20-547a-435e-a19c-6c3ba10ffdd4 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a" status: 200 len: 287 microversion: 2.1 time: 0.070103 Oct 29 13:33:21.534733 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 88/177] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Oct 29 13:33:21 2021] GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:21.545279 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c319981f-65f8-46f2-9593-27c01cac4a0f tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c49df70>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:21.601646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c319981f-65f8-46f2-9593-27c01cac4a0f tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.060949 Oct 29 13:33:21.602944 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 89/178] 10.222.0.96 () {58 vars in 1139 bytes} [Fri Oct 29 13:33:21 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:21.616880 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e047833a-1d54-4b8a-973b-07029ba823a0 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c49d1f0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:21.653364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:21.657743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e047833a-1d54-4b8a-973b-07029ba823a0 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a" status: 200 len: 287 microversion: 2.1 time: 0.048101 Oct 29 13:33:21.658594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 90/179] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Oct 29 13:33:21 2021] GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:21.662921 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:21.663637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:21.666872 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-bc5d1bdc-acf1-463e-944c-8cb8828efbda tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.306732 Oct 29 13:33:21.670927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.671363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.672287 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.672709 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.676480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 90/180] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:21 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:21.682216 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:21.683268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:21.693581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.694061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.697070 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.697491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.836106 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:21.843707 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-544af1c0-d200-4e36-b633-1008331fda7b tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.165491 Oct 29 13:33:21.844272 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 91/181] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:21 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:21.848665 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4bdbfedf-c63a-403f-b292-25fd25a34ce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:21.849554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4bdbfedf-c63a-403f-b292-25fd25a34ce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:21.855483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4bdbfedf-c63a-403f-b292-25fd25a34ce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.855928 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4bdbfedf-c63a-403f-b292-25fd25a34ce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.856697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4bdbfedf-c63a-403f-b292-25fd25a34ce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:21.857131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4bdbfedf-c63a-403f-b292-25fd25a34ce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:21.883865 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:21.892294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2234b422-f08d-44b6-aae2-d7cc19fe3a3b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.232680 Oct 29 13:33:21.892869 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 91/182] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:21 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:22.018829 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-594fbe4e-1917-4f8d-aaad-79d8abed9a9c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:22.019823 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-594fbe4e-1917-4f8d-aaad-79d8abed9a9c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:22.026129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-594fbe4e-1917-4f8d-aaad-79d8abed9a9c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:22.026649 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-594fbe4e-1917-4f8d-aaad-79d8abed9a9c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:22.027495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-594fbe4e-1917-4f8d-aaad-79d8abed9a9c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:22.028001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-594fbe4e-1917-4f8d-aaad-79d8abed9a9c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:24.866747 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-594fbe4e-1917-4f8d-aaad-79d8abed9a9c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 2.851370 Oct 29 13:33:24.870182 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 92/183] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:22 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:24.872557 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8f04f314-53f5-4964-930b-4b8ad9831a1c tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c542280>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:24.906392 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8f04f314-53f5-4964-930b-4b8ad9831a1c tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a" status: 200 len: 287 microversion: 2.1 time: 0.037476 Oct 29 13:33:24.906967 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 93/184] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Oct 29 13:33:24 2021] GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:24.911423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:24.912147 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:24.914370 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4bdbfedf-c63a-403f-b292-25fd25a34ce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 4515 microversion: 2.1 time: 3.068844 Oct 29 13:33:24.915344 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 92/185] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:21 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 4515 bytes in 3070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:24.920762 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:24.921466 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:24.922201 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:24.922651 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:24.923623 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:24.924207 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:24.929225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:24.934828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:24.938745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:24.939244 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:25.170257 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:25.180407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-412bc532-6ac8-4e74-a3f1-a16c0dde7f35 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.264166 Oct 29 13:33:25.182460 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 93/186] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:24 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:25.187907 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:25.188710 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:25.196137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:25.196913 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:25.197875 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:25.198468 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:25.272056 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:25.282867 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f6614065-4797-4893-9a48-e3f1cccd4c97 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.374514 Oct 29 13:33:25.283609 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 94/187] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:24 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:25.419896 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:25.429195 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d06adc8f-0e8b-4d79-a2b4-0d572fcc3220 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.245387 Oct 29 13:33:25.430374 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 94/188] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:25 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:25.878416 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-92d9d750-14aa-455b-8777-acecb18ba953 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:25.879407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-92d9d750-14aa-455b-8777-acecb18ba953 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:25.885147 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92d9d750-14aa-455b-8777-acecb18ba953 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:25.885605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92d9d750-14aa-455b-8777-acecb18ba953 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:25.886366 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92d9d750-14aa-455b-8777-acecb18ba953 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:25.886799 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92d9d750-14aa-455b-8777-acecb18ba953 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:25.917985 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6edf5c9f-69a7-4b12-ac28-89a5fe110d50 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c65dee0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:25.951129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6edf5c9f-69a7-4b12-ac28-89a5fe110d50 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a" status: 200 len: 288 microversion: 2.1 time: 0.036957 Oct 29 13:33:25.952053 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 95/189] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Oct 29 13:33:25 2021] GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:25.956907 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f3d68176-4110-49cf-948f-4665912f3e4f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:25.958119 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f3d68176-4110-49cf-948f-4665912f3e4f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:25.960913 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-92d9d750-14aa-455b-8777-acecb18ba953 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.085932 Oct 29 13:33:25.962236 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 95/190] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:25 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:25.965999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f3d68176-4110-49cf-948f-4665912f3e4f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:25.967173 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f3d68176-4110-49cf-948f-4665912f3e4f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:25.968473 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-06183b10-2b28-41be-a2f9-2602b6f13430 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c457b80>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:25.969470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f3d68176-4110-49cf-948f-4665912f3e4f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:25.970417 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f3d68176-4110-49cf-948f-4665912f3e4f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.031822 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-06183b10-2b28-41be-a2f9-2602b6f13430 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "DELETE /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a" status: 202 len: 0 microversion: 2.1 time: 0.068168 Oct 29 13:33:26.032493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 96/191] 10.222.0.96 () {58 vars in 1253 bytes} [Fri Oct 29 13:33:25 2021] DELETE /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:26.040006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2a508213-1319-41f4-9f4d-09a1ad6d3daa tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c458670>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:26.066397 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f3d68176-4110-49cf-948f-4665912f3e4f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 9165 microversion: 2.1 time: 0.112830 Oct 29 13:33:26.067034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 96/192] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:25 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 9165 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:26.069847 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2a508213-1319-41f4-9f4d-09a1ad6d3daa tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a" status: 200 len: 287 microversion: 2.1 time: 0.033092 Oct 29 13:33:26.070409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 97/193] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Oct 29 13:33:26 2021] GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:26.199010 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:26.199704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:26.206117 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.206615 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.208571 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.209012 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.299981 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:26.300691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:26.307602 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.308046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.309047 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.309450 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.339056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:26.346719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-58800177-8835-4b90-9f15-92695ce331df tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.151805 Oct 29 13:33:26.347279 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 97/194] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:26 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:26.427912 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:26.435073 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c24d4e9e-86c2-4727-9235-97a7de17ca0a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.138803 Oct 29 13:33:26.435639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 98/195] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:26 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:26.444787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:26.445377 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:26.451334 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.451784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.452543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.452970 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.573415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:26.580543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-26e57190-f4a3-4bfd-abde-ec9df0df8853 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.139358 Oct 29 13:33:26.581101 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 98/196] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:26 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:26.972529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f9916fb6-44e1-4672-bc63-0f32f9b31cc0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:26.973428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f9916fb6-44e1-4672-bc63-0f32f9b31cc0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:26.979192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f9916fb6-44e1-4672-bc63-0f32f9b31cc0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.979572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f9916fb6-44e1-4672-bc63-0f32f9b31cc0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:26.980313 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f9916fb6-44e1-4672-bc63-0f32f9b31cc0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:26.980741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f9916fb6-44e1-4672-bc63-0f32f9b31cc0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.059155 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f9916fb6-44e1-4672-bc63-0f32f9b31cc0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.090125 Oct 29 13:33:27.060505 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 99/197] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:26 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:27.078007 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-911836566", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "b27e33da-cc30-49c2-a24f-11585bfb590e"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:27.078202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e0ee5c22-822d-4d69-98e4-6c9dab58efc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:27.079106 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e0ee5c22-822d-4d69-98e4-6c9dab58efc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:27.084987 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0ee5c22-822d-4d69-98e4-6c9dab58efc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.085433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0ee5c22-822d-4d69-98e4-6c9dab58efc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.086224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0ee5c22-822d-4d69-98e4-6c9dab58efc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.086657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0ee5c22-822d-4d69-98e4-6c9dab58efc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.128493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] validate_networks() for [('b27e33da-cc30-49c2-a24f-11585bfb590e', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:33:27.177745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e0ee5c22-822d-4d69-98e4-6c9dab58efc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 14986 microversion: 2.1 time: 0.104421 Oct 29 13:33:27.178606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 99/198] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:27 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 14986 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:27.183277 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7de744a3-9789-4424-9a70-1b5c84d6f698 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c4760d0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:27.208343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-7de744a3-9789-4424-9a70-1b5c84d6f698 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] HTTP exception thrown: Snapshot 9967ce32-20ad-484e-b0c0-e8ef97a6332a could not be found. Oct 29 13:33:27.208939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7de744a3-9789-4424-9a70-1b5c84d6f698 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Returning 404 to user: Snapshot 9967ce32-20ad-484e-b0c0-e8ef97a6332a could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:27.209751 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7de744a3-9789-4424-9a70-1b5c84d6f698 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a" status: 404 len: 111 microversion: 2.1 time: 0.030152 Oct 29 13:33:27.210310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 100/199] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Oct 29 13:33:27 2021] GET /compute/v2.1/os-snapshots/9967ce32-20ad-484e-b0c0-e8ef97a6332a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:33:27.218310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6644c01f-f0d5-4243-8996-0a4e91b53015 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c410280>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:27.281367 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6644c01f-f0d5-4243-8996-0a4e91b53015 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd" status: 202 len: 0 microversion: 2.1 time: 0.066820 Oct 29 13:33:27.282093 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 101/200] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Oct 29 13:33:27 2021] DELETE /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:27.290203 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-58b57f03-cc12-4ee8-a234-fcacb3a5381e tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c45d0d0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:27.342444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-58b57f03-cc12-4ee8-a234-fcacb3a5381e tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd" status: 200 len: 345 microversion: 2.1 time: 0.055856 Oct 29 13:33:27.343007 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 102/201] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:27 2021] GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:27.363490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:27.364209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:27.370384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.370864 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.371628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.372061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.477429 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:33:27.477875 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:33:27.478392 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:33:27.478798 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:33:27.479203 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:33:27.488638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.489005 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.489813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.490244 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.496340 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:27.504699 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-eea75802-801f-4fcb-801e-62456ca661b7 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.144804 Oct 29 13:33:27.516230 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 103/202] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:27 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:27.516421 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Getting quotas for project a87916e4d46b448baf2db17e63eab5d7. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:33:27.516527 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:27.516527 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:27.520871 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Getting quotas for user 3c02a63b164645c39077937cea7e0991 and project a87916e4d46b448baf2db17e63eab5d7. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:33:27.535144 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.535505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.536288 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.536717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.536932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:33:27.539415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:33:27.587953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-265a0de0-0222-4b17-902b-815b2f93aaf4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.514079 Oct 29 13:33:27.592648 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 100/203] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:33:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 13:33:27.600498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:27.601232 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:27.608474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.618378 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.619600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.620326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.703442 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:27.719918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8d818a48-0e29-4b84-807a-2166bba41c93 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.209467 Oct 29 13:33:27.728118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 104/204] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:27 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:27.731451 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ff743019-c446-451b-8654-e7f38f781cb8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:27.732094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ff743019-c446-451b-8654-e7f38f781cb8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:27.754554 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:27.761918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e69da746-ff08-4e17-89fb-cca274456a5c tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.168172 Oct 29 13:33:27.762678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 101/205] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:27 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:27.803158 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ff743019-c446-451b-8654-e7f38f781cb8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:27.810844 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ff743019-c446-451b-8654-e7f38f781cb8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1213 microversion: 2.1 time: 0.088994 Oct 29 13:33:27.811734 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 105/206] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:27 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:27.897909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-0d00189d-74e5-427b-88b1-6478c61ebc0f req-1970e807-2cf2-4c1f-91c4-d1cdac4d1400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7faf1bee-b498-4510-a51e-b088632b19ed", "name": "network-vif-plugged", "status": "completed", "tag": "d544eccb-2834-4068-8fd9-568a5b3d26f1"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:27.899665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:27.899665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:27.908196 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0d00189d-74e5-427b-88b1-6478c61ebc0f req-1970e807-2cf2-4c1f-91c4-d1cdac4d1400 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:27.908724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0d00189d-74e5-427b-88b1-6478c61ebc0f req-1970e807-2cf2-4c1f-91c4-d1cdac4d1400 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:27.922684 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-0d00189d-74e5-427b-88b1-6478c61ebc0f req-1970e807-2cf2-4c1f-91c4-d1cdac4d1400 service nova] Creating event network-vif-plugged:d544eccb-2834-4068-8fd9-568a5b3d26f1 for instance 7faf1bee-b498-4510-a51e-b088632b19ed on hv-cinder-81588 Oct 29 13:33:27.927909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-0d00189d-74e5-427b-88b1-6478c61ebc0f req-1970e807-2cf2-4c1f-91c4-d1cdac4d1400 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034100 Oct 29 13:33:27.928826 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 102/207] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:28.070613 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6a4941fc-6816-4d05-84c5-d796c9c82c48 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:28.071845 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6a4941fc-6816-4d05-84c5-d796c9c82c48 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:28.078143 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6a4941fc-6816-4d05-84c5-d796c9c82c48 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.078638 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6a4941fc-6816-4d05-84c5-d796c9c82c48 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.080084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6a4941fc-6816-4d05-84c5-d796c9c82c48 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.080670 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6a4941fc-6816-4d05-84c5-d796c9c82c48 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.178068 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6a4941fc-6816-4d05-84c5-d796c9c82c48 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 14 microversion: 2.20 time: 0.110834 Oct 29 13:33:28.180598 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 106/208] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:28 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:28.190013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-57b0e4a2-ed19-459d-8008-d58edef84e62 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:28.191027 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-57b0e4a2-ed19-459d-8008-d58edef84e62 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:28.196867 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57b0e4a2-ed19-459d-8008-d58edef84e62 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.197310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57b0e4a2-ed19-459d-8008-d58edef84e62 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.198098 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57b0e4a2-ed19-459d-8008-d58edef84e62 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.198530 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57b0e4a2-ed19-459d-8008-d58edef84e62 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.355177 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9cbe4f7e-c49e-4985-a24d-43e5561bfcb5 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c48e790>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:28.383640 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-9cbe4f7e-c49e-4985-a24d-43e5561bfcb5 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] HTTP exception thrown: Volume 693b27e7-131b-4bfb-bc53-731f7adda9fd could not be found. Oct 29 13:33:28.384218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9cbe4f7e-c49e-4985-a24d-43e5561bfcb5 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Returning 404 to user: Volume 693b27e7-131b-4bfb-bc53-731f7adda9fd could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:28.385023 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9cbe4f7e-c49e-4985-a24d-43e5561bfcb5 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd" status: 404 len: 109 microversion: 2.1 time: 0.033926 Oct 29 13:33:28.385546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 107/209] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:28 2021] GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:33:28.393943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0fb78887-5f03-4214-9dd8-d848270d9e58 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c45d4c0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:28.420357 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-0fb78887-5f03-4214-9dd8-d848270d9e58 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] HTTP exception thrown: Volume 693b27e7-131b-4bfb-bc53-731f7adda9fd could not be found. Oct 29 13:33:28.420924 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0fb78887-5f03-4214-9dd8-d848270d9e58 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Returning 404 to user: Volume 693b27e7-131b-4bfb-bc53-731f7adda9fd could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:28.422036 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0fb78887-5f03-4214-9dd8-d848270d9e58 tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd" status: 404 len: 109 microversion: 2.1 time: 0.031090 Oct 29 13:33:28.422488 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 108/210] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Oct 29 13:33:28 2021] DELETE /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:33:28.429654 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9410ef3e-0530-4aa0-a2c7-26679739b9fe tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Calling method '.version_select at 0x7f547c529dc0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:28.455601 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-9410ef3e-0530-4aa0-a2c7-26679739b9fe tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] HTTP exception thrown: Volume 693b27e7-131b-4bfb-bc53-731f7adda9fd could not be found. Oct 29 13:33:28.456193 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9410ef3e-0530-4aa0-a2c7-26679739b9fe tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] Returning 404 to user: Volume 693b27e7-131b-4bfb-bc53-731f7adda9fd could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:28.457003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9410ef3e-0530-4aa0-a2c7-26679739b9fe tempest-VolumesSnapshotsTestJSON-434618443 tempest-VolumesSnapshotsTestJSON-434618443-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd" status: 404 len: 109 microversion: 2.1 time: 0.030674 Oct 29 13:33:28.457532 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 109/211] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:28 2021] GET /compute/v2.1/os-volumes/693b27e7-131b-4bfb-bc53-731f7adda9fd => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:33:28.482538 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-57b0e4a2-ed19-459d-8008-d58edef84e62 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 17861 microversion: 2.1 time: 0.296894 Oct 29 13:33:28.483656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 103/212] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:28 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 17861 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:28.525826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:28.526697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:28.533179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.533623 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.534402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.534827 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.657953 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:28.665876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8478fc78-892f-4041-9108-7e27ed285d27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.144340 Oct 29 13:33:28.666437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 110/213] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:28 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:28.737418 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:28.738255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:28.745496 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.746271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.747252 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.748093 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.779526 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:28.780127 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:28.785897 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.786339 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.787097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.787523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.908060 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:28.915659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ee2e27c5-3744-4757-9142-ff8301328333 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.182280 Oct 29 13:33:28.916561 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 104/214] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:28 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:28.917822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:28.926566 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cb6784f0-3a13-43a0-beee-ea044abacbd4 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.151039 Oct 29 13:33:28.927342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 111/215] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:28 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:28.938298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:28.938997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:28.944820 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.945341 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:28.946236 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:28.946672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.010368 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:29.018899 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6e007ee6-77aa-4f4b-8925-b495fc160432 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1265 microversion: 2.1 time: 0.092691 Oct 29 13:33:29.019864 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 105/216] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:28 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:29.191281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fb0bae6e-9cbf-4154-ab5c-6d85e977e58f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:29.193004 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fb0bae6e-9cbf-4154-ab5c-6d85e977e58f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:29.200006 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb0bae6e-9cbf-4154-ab5c-6d85e977e58f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.201486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb0bae6e-9cbf-4154-ab5c-6d85e977e58f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.202709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb0bae6e-9cbf-4154-ab5c-6d85e977e58f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.203806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb0bae6e-9cbf-4154-ab5c-6d85e977e58f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.288275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fb0bae6e-9cbf-4154-ab5c-6d85e977e58f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 6451 microversion: 2.20 time: 0.103347 Oct 29 13:33:29.291621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 112/217] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:29 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 6451 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:33:29.494310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3007e3fa-d835-4ded-816b-3f85474ef486 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:29.495207 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3007e3fa-d835-4ded-816b-3f85474ef486 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:29.502031 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3007e3fa-d835-4ded-816b-3f85474ef486 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.502476 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3007e3fa-d835-4ded-816b-3f85474ef486 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.503247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3007e3fa-d835-4ded-816b-3f85474ef486 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.503763 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3007e3fa-d835-4ded-816b-3f85474ef486 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.640503 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3007e3fa-d835-4ded-816b-3f85474ef486 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 18013 microversion: 2.1 time: 0.149552 Oct 29 13:33:29.641307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 106/218] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:29 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 18013 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:29.683934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:29.684667 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:29.692272 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.692787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.693766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.694309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.874093 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:29.881354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-87e7e50f-4157-43f7-b3dd-478b694744d5 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1319 microversion: 2.1 time: 0.201902 Oct 29 13:33:29.881943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 113/219] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:29 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:29.931537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:29.932045 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:29.940676 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.941129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.941932 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:29.942367 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:29.983491 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cd9465f5-e138-4162-a6e2-085352c1b98f tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Action: 'create', calling method: .version_select at 0x7f547c4571f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-726357715", "metadata": {"Type": "work"}}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:30.081717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:30.089334 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-624457ba-bced-495e-bea3-2de0086e553e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.161557 Oct 29 13:33:30.090057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 114/220] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:29 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:30.095309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:30.096026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:30.101864 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.102561 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.103557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.104191 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.240711 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:30.250294 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-881dff17-f38e-499d-8e7c-b0a07a5aee55 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.158242 Oct 29 13:33:30.250919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 115/221] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:30 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:30.264241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-675b8283-db62-45d4-84e0-0d008d64441f req-d129e24c-72c4-4696-a02b-bf3ac61ec797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2729e752-5a7b-4cc3-9ff3-0647ea7e7770", "name": "network-vif-plugged", "status": "completed", "tag": "d39096dc-56c6-4c48-95da-d069d4b1fb81"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:30.272023 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:30.272023 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:33:30.279452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-675b8283-db62-45d4-84e0-0d008d64441f req-d129e24c-72c4-4696-a02b-bf3ac61ec797 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.280175 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-675b8283-db62-45d4-84e0-0d008d64441f req-d129e24c-72c4-4696-a02b-bf3ac61ec797 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.291714 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-675b8283-db62-45d4-84e0-0d008d64441f req-d129e24c-72c4-4696-a02b-bf3ac61ec797 service nova] Creating event network-vif-plugged:d39096dc-56c6-4c48-95da-d069d4b1fb81 for instance 2729e752-5a7b-4cc3-9ff3-0647ea7e7770 on hv-cinder-81588 Oct 29 13:33:30.303055 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-675b8283-db62-45d4-84e0-0d008d64441f req-d129e24c-72c4-4696-a02b-bf3ac61ec797 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042219 Oct 29 13:33:30.304015 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 116/222] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:30.310533 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:30.311474 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:30.318905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.319620 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.321327 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.322286 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.331054 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cd9465f5-e138-4162-a6e2-085352c1b98f tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] 10.222.0.96 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.470542 Oct 29 13:33:30.331685 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 107/223] 10.222.0.96 () {60 vars in 1155 bytes} [Fri Oct 29 13:33:29 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 473 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 29 13:33:30.336782 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-015d5516-df1d-44a8-aff6-4425bd82c614 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:30.338226 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-015d5516-df1d-44a8-aff6-4425bd82c614 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:30.345996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-015d5516-df1d-44a8-aff6-4425bd82c614 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.346750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-015d5516-df1d-44a8-aff6-4425bd82c614 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.347748 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-015d5516-df1d-44a8-aff6-4425bd82c614 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.348373 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-015d5516-df1d-44a8-aff6-4425bd82c614 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.462369 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-015d5516-df1d-44a8-aff6-4425bd82c614 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 12459 microversion: 2.20 time: 0.128896 Oct 29 13:33:30.465505 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 108/224] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:30 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 12459 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:30.469906 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ab31e156-9b61-40ad-b0ec-dd139827419c tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Calling method '.version_select at 0x7f547c457820>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:30.477391 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:30.486981 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fbd86d94-3f92-41b2-a9db-6089c0e87342 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.181482 Oct 29 13:33:30.487772 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 117/225] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:30 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:30.533301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ab31e156-9b61-40ad-b0ec-dd139827419c tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca" status: 200 len: 352 microversion: 2.1 time: 0.068763 Oct 29 13:33:30.533897 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 109/226] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:30 2021] GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:30.652872 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cd7091dd-55cb-4453-b87b-38646ac9c8c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:30.655084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cd7091dd-55cb-4453-b87b-38646ac9c8c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:30.665913 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cd7091dd-55cb-4453-b87b-38646ac9c8c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.666436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cd7091dd-55cb-4453-b87b-38646ac9c8c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.667449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cd7091dd-55cb-4453-b87b-38646ac9c8c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.668125 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cd7091dd-55cb-4453-b87b-38646ac9c8c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.679428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-e59dc3bd-4c1a-45d1-9802-8f561a1cacef req-0d7d1411-7af9-4cf5-b204-af3cf7f3d1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab4df17-6782-4400-9af8-87a1f8748e11", "tag": "c3164b40-777c-4919-9e4a-87273007cb51"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:30.681101 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:30.681101 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:30.690162 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e59dc3bd-4c1a-45d1-9802-8f561a1cacef req-0d7d1411-7af9-4cf5-b204-af3cf7f3d1b7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.690762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e59dc3bd-4c1a-45d1-9802-8f561a1cacef req-0d7d1411-7af9-4cf5-b204-af3cf7f3d1b7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.702477 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-e59dc3bd-4c1a-45d1-9802-8f561a1cacef req-0d7d1411-7af9-4cf5-b204-af3cf7f3d1b7 service nova] Creating event network-changed:c3164b40-777c-4919-9e4a-87273007cb51 for instance 9ab4df17-6782-4400-9af8-87a1f8748e11 on hv-cinder-81588 Oct 29 13:33:30.707164 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-e59dc3bd-4c1a-45d1-9802-8f561a1cacef req-0d7d1411-7af9-4cf5-b204-af3cf7f3d1b7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031599 Oct 29 13:33:30.707750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 110/227] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:30.898435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:30.899136 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:30.905017 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.905514 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.906425 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:30.906934 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:30.924748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cd7091dd-55cb-4453-b87b-38646ac9c8c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 20164 microversion: 2.1 time: 0.275815 Oct 29 13:33:30.925810 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 118/228] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:30 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 20164 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:31.107591 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:31.108267 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:31.114633 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.115064 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.115813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.116251 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.179224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:31.187379 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7ffe42fa-6ad6-4c3d-abf1-5a50a9deb677 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1509 microversion: 2.1 time: 0.292814 Oct 29 13:33:31.188080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 111/229] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:30 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:31.243990 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:31.252444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b575db80-620f-47d9-8e96-572b315d7cf3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.149309 Oct 29 13:33:31.253015 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 119/230] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:31 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:31.266701 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:31.267282 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:31.272981 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.273643 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.274428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.274848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.439824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:31.449259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3f925f8f-6162-45ca-b5d9-c115e5556a38 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1317 microversion: 2.1 time: 0.186152 Oct 29 13:33:31.450254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 112/231] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:31 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:31.473520 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-de55da33-5413-4d5e-b8d4-5dcbdab75545 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:31.474612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-de55da33-5413-4d5e-b8d4-5dcbdab75545 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:31.480325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-de55da33-5413-4d5e-b8d4-5dcbdab75545 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.480828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-de55da33-5413-4d5e-b8d4-5dcbdab75545 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.482258 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-de55da33-5413-4d5e-b8d4-5dcbdab75545 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.482752 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-de55da33-5413-4d5e-b8d4-5dcbdab75545 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.506457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:31.507110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:31.514390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.514840 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.515618 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.516054 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.581590 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-de55da33-5413-4d5e-b8d4-5dcbdab75545 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 16162 microversion: 2.20 time: 0.111565 Oct 29 13:33:31.582822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 120/232] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:31 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 16162 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:31.588151 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-eafae376-3c2b-4a5a-91b2-d77101936a44 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Calling method '.version_select at 0x7f547c472790>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:31.648819 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-eafae376-3c2b-4a5a-91b2-d77101936a44 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca" status: 200 len: 353 microversion: 2.1 time: 0.064594 Oct 29 13:33:31.649388 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 121/233] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:31 2021] GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:31.660912 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d3ee1dc6-7e11-4a12-b068-28b30f36c174 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Calling method '.version_select at 0x7f547c45d0d0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:31.703626 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:31.711693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e1d114fa-3031-4660-9763-4735b4a3e2c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.210259 Oct 29 13:33:31.712466 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 113/234] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:31 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:31.726925 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d3ee1dc6-7e11-4a12-b068-28b30f36c174 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca" status: 200 len: 353 microversion: 2.1 time: 0.069907 Oct 29 13:33:31.727519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 122/235] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:31 2021] GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca => generated 353 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:31.743980 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bbb2f0af-58e3-4d83-8333-c613826bc346 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Calling method '.version_select at 0x7f547c542af0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:31.802121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bbb2f0af-58e3-4d83-8333-c613826bc346 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] 10.222.0.96 "DELETE /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca" status: 202 len: 0 microversion: 2.1 time: 0.061724 Oct 29 13:33:31.802956 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 114/236] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Oct 29 13:33:31 2021] DELETE /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:31.810956 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2b049beb-e5d5-49b8-b5b1-ef94f2539573 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Calling method '.version_select at 0x7f547c48e3a0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:31.862573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2b049beb-e5d5-49b8-b5b1-ef94f2539573 tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca" status: 200 len: 352 microversion: 2.1 time: 0.055358 Oct 29 13:33:31.863138 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 123/237] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:31 2021] GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:31.935260 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-46bfb989-121f-4d5a-8ba6-e162fe10c361 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:31.936301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-46bfb989-121f-4d5a-8ba6-e162fe10c361 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:31.942056 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-46bfb989-121f-4d5a-8ba6-e162fe10c361 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.942500 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-46bfb989-121f-4d5a-8ba6-e162fe10c361 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:31.943256 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-46bfb989-121f-4d5a-8ba6-e162fe10c361 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:31.943685 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-46bfb989-121f-4d5a-8ba6-e162fe10c361 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.073307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-46bfb989-121f-4d5a-8ba6-e162fe10c361 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 21965 microversion: 2.1 time: 0.141447 Oct 29 13:33:32.073980 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 115/238] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:31 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 21965 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:32.271062 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:32.271792 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:32.277780 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.278257 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.279079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.279495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.409675 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:32.416951 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fdde3e0e-9a1d-4558-9b44-7f2cff4cbdf9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.150197 Oct 29 13:33:32.417515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 124/239] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:32 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:32.466619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:32.467321 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:32.473710 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.474192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.474955 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.475389 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.592378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a9a4ec50-9c9f-4cd4-ab8c-a694c7f52831 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:32.593342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a9a4ec50-9c9f-4cd4-ab8c-a694c7f52831 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:32.598304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:32.599470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9a4ec50-9c9f-4cd4-ab8c-a694c7f52831 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.599912 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9a4ec50-9c9f-4cd4-ab8c-a694c7f52831 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.600669 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9a4ec50-9c9f-4cd4-ab8c-a694c7f52831 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.601091 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9a4ec50-9c9f-4cd4-ab8c-a694c7f52831 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.605601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a69219be-6834-47d9-b06f-003040351c73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1506 microversion: 2.1 time: 0.142948 Oct 29 13:33:32.606197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 116/240] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:32 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1506 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:32.623704 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c588e64-68dc-492f-87a2-7c609caca9fa"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:32.624652 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:32.630425 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.630859 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.631638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.632075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.720123 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] HTTP exception thrown: Invalid volume: volume 9c588e64-68dc-492f-87a2-7c609caca9fa is already attached to instances: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd Oct 29 13:33:32.720787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a9a4ec50-9c9f-4cd4-ab8c-a694c7f52831 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 17602 microversion: 2.20 time: 0.131546 Oct 29 13:33:32.720893 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Returning 400 to user: Invalid volume: volume 9c588e64-68dc-492f-87a2-7c609caca9fa is already attached to instances: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:32.721489 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 125/241] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:32 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 17602 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:32.721634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-40482a33-211a-41b7-af8c-8912a13ed0ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102616 Oct 29 13:33:32.722258 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 117/242] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:33:32 2021] POST /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 29 13:33:32.736471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:32.737245 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:32.745088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.745609 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.746516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.746937 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.788211 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:32.788689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:32.795960 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.796395 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.797191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:32.797617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:32.874608 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:32.882211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-34133956-8dc5-4791-9780-83247c1c39e4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.157579 Oct 29 13:33:32.882781 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 126/243] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:32 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:32.891571 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-29280f86-ae6d-475b-ba47-9566dd34e81f tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Calling method '.version_select at 0x7f547c4b3f70>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:32.913448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-29280f86-ae6d-475b-ba47-9566dd34e81f tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] HTTP exception thrown: Volume 06542b02-45b2-4785-a88e-0654c24359ca could not be found. Oct 29 13:33:32.914279 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-29280f86-ae6d-475b-ba47-9566dd34e81f tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] Returning 404 to user: Volume 06542b02-45b2-4785-a88e-0654c24359ca could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:32.915276 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-29280f86-ae6d-475b-ba47-9566dd34e81f tempest-VolumesGetTestJSON-954193349 tempest-VolumesGetTestJSON-954193349-project] 10.222.0.96 "GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca" status: 404 len: 109 microversion: 2.1 time: 0.031582 Oct 29 13:33:32.915843 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 127/244] 10.222.0.96 () {58 vars in 1244 bytes} [Fri Oct 29 13:33:32 2021] GET /compute/v2.1/os-volumes/06542b02-45b2-4785-a88e-0654c24359ca => generated 109 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:33:32.929893 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lazy-loading 'services' on Instance uuid bd2ea5b2-033b-4585-b78d-30ba7fbd82bd {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:33:33.037428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-585a1752-ce8f-4b69-8d0b-9f72d674f45a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "DELETE /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments/9c588e64-68dc-492f-87a2-7c609caca9fa" status: 202 len: 0 microversion: 2.1 time: 0.252713 Oct 29 13:33:33.041221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 118/245] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:33:32 2021] DELETE /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments/9c588e64-68dc-492f-87a2-7c609caca9fa => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:33.046986 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-31712717-5635-4183-9a9c-e7d6098115bb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:33.048619 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-31712717-5635-4183-9a9c-e7d6098115bb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:33.057177 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31712717-5635-4183-9a9c-e7d6098115bb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.057730 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31712717-5635-4183-9a9c-e7d6098115bb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.058960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31712717-5635-4183-9a9c-e7d6098115bb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.059759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31712717-5635-4183-9a9c-e7d6098115bb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.086117 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3fe593ba-20e4-42ca-b700-5578a62e48dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:33.088354 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3fe593ba-20e4-42ca-b700-5578a62e48dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:33.095037 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3fe593ba-20e4-42ca-b700-5578a62e48dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.095685 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3fe593ba-20e4-42ca-b700-5578a62e48dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.095929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-31712717-5635-4183-9a9c-e7d6098115bb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053382 Oct 29 13:33:33.096773 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 128/246] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:33:33 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:33.097258 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3fe593ba-20e4-42ca-b700-5578a62e48dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.097941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3fe593ba-20e4-42ca-b700-5578a62e48dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.211102 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3fe593ba-20e4-42ca-b700-5578a62e48dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 22973 microversion: 2.1 time: 0.129209 Oct 29 13:33:33.211721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 119/247] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:33 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 22973 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:33.434417 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:33.435169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:33.440860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.441379 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.442165 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.442588 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.598721 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:33.606099 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0125e090-2bc1-457e-907e-1d7266fc2d55 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.175318 Oct 29 13:33:33.606869 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 129/248] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:33 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:33.735659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-36ba2aca-6f33-4f75-b0c8-82803d808d09 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:33.736679 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-36ba2aca-6f33-4f75-b0c8-82803d808d09 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:33.744377 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36ba2aca-6f33-4f75-b0c8-82803d808d09 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.744932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36ba2aca-6f33-4f75-b0c8-82803d808d09 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.745905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36ba2aca-6f33-4f75-b0c8-82803d808d09 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.746611 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36ba2aca-6f33-4f75-b0c8-82803d808d09 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.883382 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-36ba2aca-6f33-4f75-b0c8-82803d808d09 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 17834 microversion: 2.20 time: 0.152479 Oct 29 13:33:33.884259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 120/249] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:33 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 17834 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:33.898562 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:33.899074 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:33.906209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.906645 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:33.907517 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:33.908188 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.034915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:34.046493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0fbdccce-a42d-465b-98a0-2b9300695479 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.151891 Oct 29 13:33:34.047097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 130/250] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:33 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:34.108272 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0d152749-b2c2-49d2-a0c9-4235ec87defd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:34.109266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0d152749-b2c2-49d2-a0c9-4235ec87defd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:34.115767 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d152749-b2c2-49d2-a0c9-4235ec87defd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.116258 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d152749-b2c2-49d2-a0c9-4235ec87defd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.117027 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d152749-b2c2-49d2-a0c9-4235ec87defd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.117462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d152749-b2c2-49d2-a0c9-4235ec87defd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.223150 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-27a557d9-b46e-44c5-98f9-4f49a1166589 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:34.224696 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-27a557d9-b46e-44c5-98f9-4f49a1166589 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:34.231138 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-27a557d9-b46e-44c5-98f9-4f49a1166589 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.232327 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-27a557d9-b46e-44c5-98f9-4f49a1166589 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.233378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-27a557d9-b46e-44c5-98f9-4f49a1166589 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.234301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-27a557d9-b46e-44c5-98f9-4f49a1166589 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.293194 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0d152749-b2c2-49d2-a0c9-4235ec87defd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.189708 Oct 29 13:33:34.299412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 121/251] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:33:34 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:33:34.354669 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-27a557d9-b46e-44c5-98f9-4f49a1166589 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 23794 microversion: 2.1 time: 0.135064 Oct 29 13:33:34.355555 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 131/252] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:34 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 23794 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:33:34.482883 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1412006498", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "797a2d64-a318-481c-b064-119a76b4777f"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:34.535813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] validate_networks() for [('797a2d64-a318-481c-b064-119a76b4777f', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:33:34.624552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:34.625257 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:34.631973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.632423 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.633381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.633837 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.772709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:34.780679 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6cdf2a50-0f40-4723-b072-304eba61927c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.161177 Oct 29 13:33:34.781242 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 132/253] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:34 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:34.895468 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e85167f9-00f8-4e46-a3b6-088850b47c7f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:34.896611 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e85167f9-00f8-4e46-a3b6-088850b47c7f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:34.908891 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e85167f9-00f8-4e46-a3b6-088850b47c7f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.909546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e85167f9-00f8-4e46-a3b6-088850b47c7f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.910406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e85167f9-00f8-4e46-a3b6-088850b47c7f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.910757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e85167f9-00f8-4e46-a3b6-088850b47c7f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.925522 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:33:34.926528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:33:34.927020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:33:34.927421 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:33:34.927980 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:33:34.938605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.939676 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.940699 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:34.941299 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:34.959166 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:33:34.962997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for user b827e16aad5a47d0bfeebfc3da8a94b9 and project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:33:34.974318 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:33:34.976612 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:33:34.995000 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e85167f9-00f8-4e46-a3b6-088850b47c7f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 19342 microversion: 2.20 time: 0.102932 Oct 29 13:33:34.995842 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 133/254] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:34 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 19342 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:35.025673 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-470e6894-e61a-4300-bae6-c628450f68e9 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.546335 Oct 29 13:33:35.026518 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 122/255] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:33:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:33:35.037904 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-35d7c8a8-5eb3-4fc8-bd9d-e9e330e5a4f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:35.038500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-35d7c8a8-5eb3-4fc8-bd9d-e9e330e5a4f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:35.065006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:35.065757 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:35.072396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:35.072975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:35.073881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:35.074413 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:35.092417 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-35d7c8a8-5eb3-4fc8-bd9d-e9e330e5a4f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:35.099249 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-35d7c8a8-5eb3-4fc8-bd9d-e9e330e5a4f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1218 microversion: 2.1 time: 0.066072 Oct 29 13:33:35.100001 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 134/256] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:35 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:35.210792 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:35.219011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c4afa826-9371-4553-b5e7-e3df7a41232f tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.158797 Oct 29 13:33:35.228349 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 123/257] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:35 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:35.372651 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-eafd06ab-a5b9-47e0-9a86-4325c6f7eee6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:35.373839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-eafd06ab-a5b9-47e0-9a86-4325c6f7eee6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:35.383737 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eafd06ab-a5b9-47e0-9a86-4325c6f7eee6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:35.384185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eafd06ab-a5b9-47e0-9a86-4325c6f7eee6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:35.384939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eafd06ab-a5b9-47e0-9a86-4325c6f7eee6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:35.385359 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eafd06ab-a5b9-47e0-9a86-4325c6f7eee6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:35.462202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-eafd06ab-a5b9-47e0-9a86-4325c6f7eee6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 24692 microversion: 2.1 time: 0.093213 Oct 29 13:33:35.463105 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 135/258] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:35 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 24692 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:35.797697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:35.798427 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:35.804266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:35.804774 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:35.806837 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:35.807494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:35.941672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:35.949154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-340883b0-2516-4255-8ef3-082d0e13d57d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.155788 Oct 29 13:33:35.949858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 124/259] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:35 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:36.010585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ebf1850b-e22c-4f72-a54d-3045b88013b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:36.011624 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ebf1850b-e22c-4f72-a54d-3045b88013b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:36.018737 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ebf1850b-e22c-4f72-a54d-3045b88013b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.019172 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ebf1850b-e22c-4f72-a54d-3045b88013b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.020020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ebf1850b-e22c-4f72-a54d-3045b88013b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.020528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ebf1850b-e22c-4f72-a54d-3045b88013b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.117552 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:36.118486 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:36.127561 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.128018 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.128792 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.129221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.131876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ebf1850b-e22c-4f72-a54d-3045b88013b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 21226 microversion: 2.20 time: 0.125235 Oct 29 13:33:36.133688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 136/260] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:36 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 21226 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:36.193805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:36.202652 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f0636f2d-4169-4b81-aa5b-fdd38398feba tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1270 microversion: 2.1 time: 0.089503 Oct 29 13:33:36.203326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 125/261] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:36 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:36.235860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:36.236785 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:36.244116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.244786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.245910 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.246364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.463618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:36.473980 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2fb2b5b2-43e1-40e6-b766-572ebea79be5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:36.474959 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2fb2b5b2-43e1-40e6-b766-572ebea79be5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:36.479850 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6d2f9314-f5eb-4976-87ab-03e9e1c5753b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.248071 Oct 29 13:33:36.480759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 137/262] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:36 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:36.485953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb2b5b2-43e1-40e6-b766-572ebea79be5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.486612 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb2b5b2-43e1-40e6-b766-572ebea79be5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.487547 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb2b5b2-43e1-40e6-b766-572ebea79be5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.488133 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb2b5b2-43e1-40e6-b766-572ebea79be5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.605365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2fb2b5b2-43e1-40e6-b766-572ebea79be5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 25278 microversion: 2.1 time: 0.135526 Oct 29 13:33:36.606172 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 126/263] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:36 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 25278 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:33:36.974771 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:36.975344 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:36.981219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.982360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:36.983138 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:36.983569 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.114939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:37.124196 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-99b49c50-5e64-4ac6-8232-c17e0c1439f7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.161721 Oct 29 13:33:37.125061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 138/264] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:36 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:37.145039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5fcbeb92-a280-4e84-af35-dc9233cc1f7d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:37.149386 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5fcbeb92-a280-4e84-af35-dc9233cc1f7d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:37.158916 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5fcbeb92-a280-4e84-af35-dc9233cc1f7d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.159653 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5fcbeb92-a280-4e84-af35-dc9233cc1f7d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.160593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5fcbeb92-a280-4e84-af35-dc9233cc1f7d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.161032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5fcbeb92-a280-4e84-af35-dc9233cc1f7d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.220479 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:37.221008 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:37.227396 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.227835 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.228778 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.229361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.281068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5fcbeb92-a280-4e84-af35-dc9233cc1f7d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 22661 microversion: 2.20 time: 0.140894 Oct 29 13:33:37.282296 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 127/265] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:37 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 22661 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:37.367358 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:37.375172 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a706bceb-cf86-4b58-9865-9844801ea9da tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.159123 Oct 29 13:33:37.376073 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 139/266] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:37 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:37.498643 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:37.499662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:37.506466 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.507240 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.508270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.508923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.623510 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-45d33753-d302-41de-8aff-31142bf9dfe8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:37.625135 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-45d33753-d302-41de-8aff-31142bf9dfe8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:37.634235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-45d33753-d302-41de-8aff-31142bf9dfe8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.634955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-45d33753-d302-41de-8aff-31142bf9dfe8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.635868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-45d33753-d302-41de-8aff-31142bf9dfe8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.636450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-45d33753-d302-41de-8aff-31142bf9dfe8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.733719 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:37.743016 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ec9f39f1-2377-46bb-b1ed-39847cd43365 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.249140 Oct 29 13:33:37.744629 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 128/267] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:37 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:37.761408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-45d33753-d302-41de-8aff-31142bf9dfe8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 26061 microversion: 2.1 time: 0.145777 Oct 29 13:33:37.764417 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 140/268] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:37 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 26061 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:37.814616 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-2b1a7148-9842-4b06-957d-8a037115dfdd req-78661dd6-a330-47af-9cb7-725b101c6247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab4df17-6782-4400-9af8-87a1f8748e11", "name": "network-vif-plugged", "status": "completed", "tag": "c3164b40-777c-4919-9e4a-87273007cb51"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:37.816199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:37.816199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:37.827342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2b1a7148-9842-4b06-957d-8a037115dfdd req-78661dd6-a330-47af-9cb7-725b101c6247 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.828205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2b1a7148-9842-4b06-957d-8a037115dfdd req-78661dd6-a330-47af-9cb7-725b101c6247 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.830185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-667595c2-5511-4f6b-859d-ff120430474d req-1173bc38-7af5-4c0b-a7ac-7db3c0f4fd76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bccbf8d-3727-4704-abe1-27a1f8130529", "tag": "eeb6e964-ec30-49bc-9a5f-8bfdad363b41"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:37.832043 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:37.832043 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:33:37.842640 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-667595c2-5511-4f6b-859d-ff120430474d req-1173bc38-7af5-4c0b-a7ac-7db3c0f4fd76 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:37.846227 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-667595c2-5511-4f6b-859d-ff120430474d req-1173bc38-7af5-4c0b-a7ac-7db3c0f4fd76 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:37.848336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-2b1a7148-9842-4b06-957d-8a037115dfdd req-78661dd6-a330-47af-9cb7-725b101c6247 service nova] Creating event network-vif-plugged:c3164b40-777c-4919-9e4a-87273007cb51 for instance 9ab4df17-6782-4400-9af8-87a1f8748e11 on hv-cinder-81588 Oct 29 13:33:37.863721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-2b1a7148-9842-4b06-957d-8a037115dfdd req-78661dd6-a330-47af-9cb7-725b101c6247 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055018 Oct 29 13:33:37.864598 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 129/269] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:37.871024 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-667595c2-5511-4f6b-859d-ff120430474d req-1173bc38-7af5-4c0b-a7ac-7db3c0f4fd76 service nova] Creating event network-changed:eeb6e964-ec30-49bc-9a5f-8bfdad363b41 for instance 9bccbf8d-3727-4704-abe1-27a1f8130529 on hv-cinder-81588 Oct 29 13:33:37.877730 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-667595c2-5511-4f6b-859d-ff120430474d req-1173bc38-7af5-4c0b-a7ac-7db3c0f4fd76 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052174 Oct 29 13:33:37.878504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 141/270] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:38.141078 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:38.141810 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:38.148640 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.149201 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.149997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.150422 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.292411 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ddc86c65-5e63-4b66-acf1-f5479f4a32f9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:38.293349 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ddc86c65-5e63-4b66-acf1-f5479f4a32f9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:38.300223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddc86c65-5e63-4b66-acf1-f5479f4a32f9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.300664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddc86c65-5e63-4b66-acf1-f5479f4a32f9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.301439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddc86c65-5e63-4b66-acf1-f5479f4a32f9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.301960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ddc86c65-5e63-4b66-acf1-f5479f4a32f9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.525612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ddc86c65-5e63-4b66-acf1-f5479f4a32f9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 23434 microversion: 2.20 time: 0.237262 Oct 29 13:33:38.530120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 142/271] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:38 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 23434 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:38.532116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:38.533061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:38.540030 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.540470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.541250 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.541678 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.545693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:38.553112 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-18381e56-bfa6-45c9-b159-30f8cd5381d5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.416388 Oct 29 13:33:38.553822 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 130/272] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:38 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:38.670482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:38.677703 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3835f906-f5da-4895-9fb5-462d95523323 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.150170 Oct 29 13:33:38.678299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 143/273] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:38 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:38.762081 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:38.763226 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:38.769113 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.769553 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.770352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.770780 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.775389 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b23133e8-b056-4bf6-a404-6feee986f113 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:38.776369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b23133e8-b056-4bf6-a404-6feee986f113 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:38.782708 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b23133e8-b056-4bf6-a404-6feee986f113 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.784027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b23133e8-b056-4bf6-a404-6feee986f113 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.784794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b23133e8-b056-4bf6-a404-6feee986f113 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:38.785221 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b23133e8-b056-4bf6-a404-6feee986f113 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:38.899211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b23133e8-b056-4bf6-a404-6feee986f113 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 26699 microversion: 2.1 time: 0.127224 Oct 29 13:33:38.902253 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 144/274] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:38 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 26699 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:38.971505 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:38.978668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3c65c7a7-1f38-4e39-9901-13ee7b9c0676 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.220318 Oct 29 13:33:38.979222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 131/275] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:38 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:39.538521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6030c30c-bded-461d-a5bf-59c57a9a7b59 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:39.539501 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6030c30c-bded-461d-a5bf-59c57a9a7b59 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:39.546932 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6030c30c-bded-461d-a5bf-59c57a9a7b59 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.547371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6030c30c-bded-461d-a5bf-59c57a9a7b59 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.548336 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6030c30c-bded-461d-a5bf-59c57a9a7b59 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.548833 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6030c30c-bded-461d-a5bf-59c57a9a7b59 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.569940 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:39.570545 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:39.577634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.578107 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.578873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.579352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.676516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6030c30c-bded-461d-a5bf-59c57a9a7b59 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 24130 microversion: 2.20 time: 0.142339 Oct 29 13:33:39.677180 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 145/276] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:39 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 24130 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:39.694427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:39.695108 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:39.698927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:39.702079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.702522 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.703276 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.703697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.706973 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c62541ee-cea9-479f-afa7-8f01c9845c23 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.140828 Oct 29 13:33:39.707612 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 132/277] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:39 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:39.828734 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:39.836307 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ab058b7e-a7e1-43f0-b03d-67909f5f5fe5 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.145593 Oct 29 13:33:39.836832 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 146/278] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:39 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:39.910177 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-78fb9367-3c62-4dc3-a26e-5b7238998d3e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:39.911085 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-78fb9367-3c62-4dc3-a26e-5b7238998d3e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:39.917327 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78fb9367-3c62-4dc3-a26e-5b7238998d3e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.917794 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78fb9367-3c62-4dc3-a26e-5b7238998d3e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.918587 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78fb9367-3c62-4dc3-a26e-5b7238998d3e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:39.919620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78fb9367-3c62-4dc3-a26e-5b7238998d3e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:39.995300 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:39.995896 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:40.002642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.003161 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.003908 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.005970 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.049642 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-78fb9367-3c62-4dc3-a26e-5b7238998d3e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 27007 microversion: 2.1 time: 0.142832 Oct 29 13:33:40.055962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 133/279] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:39 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 27007 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:40.131240 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:40.138471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-706eaa6b-066c-444e-9c95-a4b6d48542e2 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1313 microversion: 2.1 time: 0.146763 Oct 29 13:33:40.139021 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 147/280] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:39 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:40.688504 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-47e30717-5aa7-495f-a578-73e6aa4e00dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:40.689518 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-47e30717-5aa7-495f-a578-73e6aa4e00dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:40.696047 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-47e30717-5aa7-495f-a578-73e6aa4e00dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.696541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-47e30717-5aa7-495f-a578-73e6aa4e00dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.697237 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-47e30717-5aa7-495f-a578-73e6aa4e00dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.697667 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-47e30717-5aa7-495f-a578-73e6aa4e00dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.724369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:40.725022 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:40.731278 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.731724 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.732507 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.732940 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.802637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-47e30717-5aa7-495f-a578-73e6aa4e00dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 24666 microversion: 2.20 time: 0.118301 Oct 29 13:33:40.804106 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 134/281] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:40 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 24666 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:40.853752 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:40.854586 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:40.862882 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.863334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.864132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:40.865183 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:40.865300 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:40.873188 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d1183f02-258b-4e7e-838a-19f11464d74a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.152159 Oct 29 13:33:40.874523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 148/282] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:40 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:40.994354 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:41.003557 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7a697aa1-1f7d-46b5-a4c1-5b79038a5aa1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.153771 Oct 29 13:33:41.003557 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 135/283] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:40 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:41.063516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e60ab252-aa66-451f-93b3-2fd0b8444327 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:41.064431 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e60ab252-aa66-451f-93b3-2fd0b8444327 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:41.071330 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e60ab252-aa66-451f-93b3-2fd0b8444327 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.071781 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e60ab252-aa66-451f-93b3-2fd0b8444327 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.072613 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e60ab252-aa66-451f-93b3-2fd0b8444327 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.072992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e60ab252-aa66-451f-93b3-2fd0b8444327 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.155146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:41.155760 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:41.161512 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.161993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.162946 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.163310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.189455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e60ab252-aa66-451f-93b3-2fd0b8444327 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 27471 microversion: 2.1 time: 0.129843 Oct 29 13:33:41.190915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 149/284] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:41 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 27471 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:41.290813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:41.298527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-371fb22e-f62d-4ec0-8c39-3c6371c32a8b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1496 microversion: 2.1 time: 0.146986 Oct 29 13:33:41.299075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 136/285] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:41 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1496 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:41.818049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-df698ed7-55b6-4012-9971-b7db5f5ff8de tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:41.819125 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-df698ed7-55b6-4012-9971-b7db5f5ff8de tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:41.825865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df698ed7-55b6-4012-9971-b7db5f5ff8de tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.827377 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df698ed7-55b6-4012-9971-b7db5f5ff8de tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.828466 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df698ed7-55b6-4012-9971-b7db5f5ff8de tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.829113 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df698ed7-55b6-4012-9971-b7db5f5ff8de tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.891240 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:41.891848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:41.903964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.903964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.903964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.903964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.934678 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-df698ed7-55b6-4012-9971-b7db5f5ff8de tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 25564 microversion: 2.20 time: 0.123636 Oct 29 13:33:41.936021 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 150/286] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:41 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 25564 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:41.943178 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:41.943871 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:41.954735 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.955346 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.956184 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:41.956616 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:41.984726 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:33:42.035838 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:42.045000 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-97c86452-821a-4900-9630-78f85136f448 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.157771 Oct 29 13:33:42.045723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 137/287] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:41 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:42.050765 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:42.051544 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:42.058318 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.059408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:42.060366 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.062344 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:42.098609 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5c3e15a2-9ddd-415f-b37e-35e72ee8df51 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 204 len: 0 microversion: 2.1 time: 0.161106 Oct 29 13:33:42.099151 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 151/288] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:33:41 2021] DELETE /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:33:42.111545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:42.112406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:42.119061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.119635 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:42.120754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.121282 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:42.203090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:42.210500 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8588da1c-cb3e-4e0f-8379-2ede6ff4562f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.163519 Oct 29 13:33:42.211342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 138/289] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:42 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:42.217840 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-df5fd487-581b-4f77-b170-357add2957a8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:42.219080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-df5fd487-581b-4f77-b170-357add2957a8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:42.226925 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df5fd487-581b-4f77-b170-357add2957a8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.227450 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df5fd487-581b-4f77-b170-357add2957a8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:42.228268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df5fd487-581b-4f77-b170-357add2957a8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.228779 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df5fd487-581b-4f77-b170-357add2957a8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:42.329542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:42.340049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f4a3eb9a-b043-4333-be12-9116ca004c26 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1502 microversion: 2.1 time: 0.231153 Oct 29 13:33:42.341012 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 152/290] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:42 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1502 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:42.352354 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-df5fd487-581b-4f77-b170-357add2957a8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 27706 microversion: 2.1 time: 0.138736 Oct 29 13:33:42.356910 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 139/291] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:42 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 27706 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:42.946853 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d4ff2728-47e3-45ea-9b61-36e49a6bf5dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:42.947757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d4ff2728-47e3-45ea-9b61-36e49a6bf5dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:42.954119 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d4ff2728-47e3-45ea-9b61-36e49a6bf5dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.954563 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d4ff2728-47e3-45ea-9b61-36e49a6bf5dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:42.955323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d4ff2728-47e3-45ea-9b61-36e49a6bf5dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:42.955754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d4ff2728-47e3-45ea-9b61-36e49a6bf5dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.055870 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d4ff2728-47e3-45ea-9b61-36e49a6bf5dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 26072 microversion: 2.20 time: 0.112549 Oct 29 13:33:43.056598 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 153/292] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:42 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 26072 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:43.062765 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:43.064202 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:43.070431 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.070876 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.071645 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.072077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.198878 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:43.207980 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a2502e6b-ab90-4e54-9407-ab37b08f4238 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.149930 Oct 29 13:33:43.208904 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 140/293] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:43 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:43.227872 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:43.228584 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:43.234733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.235180 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.235947 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.236538 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.357766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:43.358673 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:43.364788 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.365414 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.366426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.366854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.376217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:43.386642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b1d35dee-8740-4922-b89c-df289fd59c6d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.159940 Oct 29 13:33:43.386642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 154/294] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:43 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:43.389514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4cbbf6f6-c723-40f1-89ee-6b1c70ccfe10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:43.390508 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4cbbf6f6-c723-40f1-89ee-6b1c70ccfe10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:43.397323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cbbf6f6-c723-40f1-89ee-6b1c70ccfe10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.398008 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cbbf6f6-c723-40f1-89ee-6b1c70ccfe10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.398783 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cbbf6f6-c723-40f1-89ee-6b1c70ccfe10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:43.399385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cbbf6f6-c723-40f1-89ee-6b1c70ccfe10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:43.507478 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4cbbf6f6-c723-40f1-89ee-6b1c70ccfe10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 27868 microversion: 2.1 time: 0.121676 Oct 29 13:33:43.508745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 155/295] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:43 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 27868 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:43.516068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:43.523610 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-72e637c9-b848-4b4c-90c1-0b46fced891c tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1502 microversion: 2.1 time: 0.169622 Oct 29 13:33:43.524265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 141/296] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:43 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:44.068449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b33aff10-ed24-4e03-b5e8-79097624699b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:44.069444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b33aff10-ed24-4e03-b5e8-79097624699b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:44.075814 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b33aff10-ed24-4e03-b5e8-79097624699b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.076255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b33aff10-ed24-4e03-b5e8-79097624699b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.077029 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b33aff10-ed24-4e03-b5e8-79097624699b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.077456 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b33aff10-ed24-4e03-b5e8-79097624699b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.188008 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b33aff10-ed24-4e03-b5e8-79097624699b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 26600 microversion: 2.20 time: 0.123211 Oct 29 13:33:44.190343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 156/297] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:44 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 26600 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:44.225732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:44.226361 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:44.233052 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.233505 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.234314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.234749 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.402385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:44.403101 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:44.409579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:44.413956 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.414721 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.415674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.416373 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.426177 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3107e30b-a878-45d9-8f5d-a5a7051d68c9 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.203364 Oct 29 13:33:44.427118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 142/298] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:44 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:44.519605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ecfe6c06-94da-4070-ab7e-7dc8ec2ee9f9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:44.520845 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ecfe6c06-94da-4070-ab7e-7dc8ec2ee9f9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:44.527480 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ecfe6c06-94da-4070-ab7e-7dc8ec2ee9f9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.528145 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ecfe6c06-94da-4070-ab7e-7dc8ec2ee9f9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.529124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ecfe6c06-94da-4070-ab7e-7dc8ec2ee9f9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.530357 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ecfe6c06-94da-4070-ab7e-7dc8ec2ee9f9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.554406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:44.562181 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-df7f0904-75db-4fc1-b525-a100378a42f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.165179 Oct 29 13:33:44.563061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 157/299] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:44 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:44.568147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:44.568913 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:44.575328 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.575778 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.577145 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:44.577578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:44.642263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ecfe6c06-94da-4070-ab7e-7dc8ec2ee9f9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28012 microversion: 2.1 time: 0.126055 Oct 29 13:33:44.643185 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 143/300] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:44 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28012 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:44.722771 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:44.733367 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-58f3a2a6-e6f7-4f23-8ec6-b50aa09e0ede tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1502 microversion: 2.1 time: 0.167758 Oct 29 13:33:44.734065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 158/301] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:44 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:45.094008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-0e9b347f-b035-4e9d-adcf-253c08f75c32 req-cfdba286-8d21-4607-84ea-d5b717b1372b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab4df17-6782-4400-9af8-87a1f8748e11", "name": "network-vif-deleted", "tag": "c3164b40-777c-4919-9e4a-87273007cb51"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:45.095628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:45.095628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:33:45.102916 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0e9b347f-b035-4e9d-adcf-253c08f75c32 req-cfdba286-8d21-4607-84ea-d5b717b1372b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.103385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0e9b347f-b035-4e9d-adcf-253c08f75c32 req-cfdba286-8d21-4607-84ea-d5b717b1372b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.119724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-0e9b347f-b035-4e9d-adcf-253c08f75c32 req-cfdba286-8d21-4607-84ea-d5b717b1372b service nova] Creating event network-vif-deleted:c3164b40-777c-4919-9e4a-87273007cb51 for instance 9ab4df17-6782-4400-9af8-87a1f8748e11 on hv-cinder-81588 Oct 29 13:33:45.124763 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-0e9b347f-b035-4e9d-adcf-253c08f75c32 req-cfdba286-8d21-4607-84ea-d5b717b1372b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035128 Oct 29 13:33:45.125360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 144/302] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:45.201793 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a0a357a3-fa49-4e6c-b29e-a2e0aec7b51c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:45.202860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a0a357a3-fa49-4e6c-b29e-a2e0aec7b51c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:45.209452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0a357a3-fa49-4e6c-b29e-a2e0aec7b51c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.209874 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0a357a3-fa49-4e6c-b29e-a2e0aec7b51c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.210811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0a357a3-fa49-4e6c-b29e-a2e0aec7b51c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.211428 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0a357a3-fa49-4e6c-b29e-a2e0aec7b51c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.443446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:45.444138 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:45.450266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.450657 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.451424 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.451852 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.461424 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a0a357a3-fa49-4e6c-b29e-a2e0aec7b51c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 27107 microversion: 2.20 time: 0.264256 Oct 29 13:33:45.462731 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 159/303] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:45 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 27107 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:45.579170 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:45.580053 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:45.581151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:45.586315 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.586757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.587528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.587957 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.589365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2b2fc754-6c51-4580-afec-3119876a87e2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.149816 Oct 29 13:33:45.590043 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 145/304] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:45 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:45.654913 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2545871d-0990-4bfa-b678-7693ac10071d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:45.655990 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2545871d-0990-4bfa-b678-7693ac10071d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:45.663184 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2545871d-0990-4bfa-b678-7693ac10071d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.663885 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2545871d-0990-4bfa-b678-7693ac10071d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.664748 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2545871d-0990-4bfa-b678-7693ac10071d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.665341 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2545871d-0990-4bfa-b678-7693ac10071d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.772586 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2545871d-0990-4bfa-b678-7693ac10071d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28167 microversion: 2.1 time: 0.120628 Oct 29 13:33:45.773450 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 146/305] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:45 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28167 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:33:45.781042 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:45.781746 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:45.788310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:45.797133 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.797388 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-06853d92-1160-4625-b6b4-e874caac29b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.222578 Oct 29 13:33:45.797579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.798147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 160/306] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:45 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:45.802341 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.802968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.837494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.837997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.838508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lazy-loading 'fault' on Instance uuid 9ab4df17-6782-4400-9af8-87a1f8748e11 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:33:45.844885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-988538aa-6d71-40c1-adfa-31cf1ae4382f req-47f4166c-ff68-43df-ac8e-863633dd4bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bccbf8d-3727-4704-abe1-27a1f8130529", "name": "network-vif-plugged", "status": "completed", "tag": "eeb6e964-ec30-49bc-9a5f-8bfdad363b41"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:45.850545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:45.850545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:33:45.863679 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-988538aa-6d71-40c1-adfa-31cf1ae4382f req-47f4166c-ff68-43df-ac8e-863633dd4bc9 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:45.864132 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-988538aa-6d71-40c1-adfa-31cf1ae4382f req-47f4166c-ff68-43df-ac8e-863633dd4bc9 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:45.884051 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-988538aa-6d71-40c1-adfa-31cf1ae4382f req-47f4166c-ff68-43df-ac8e-863633dd4bc9 service nova] Creating event network-vif-plugged:eeb6e964-ec30-49bc-9a5f-8bfdad363b41 for instance 9bccbf8d-3727-4704-abe1-27a1f8130529 on hv-cinder-81588 Oct 29 13:33:45.889059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-988538aa-6d71-40c1-adfa-31cf1ae4382f req-47f4166c-ff68-43df-ac8e-863633dd4bc9 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055406 Oct 29 13:33:45.890519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 161/307] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:45.900874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:45.908459 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-17794f88-7a76-4e2b-8efa-b1983e9767c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 200 len: 1303 microversion: 2.1 time: 0.133658 Oct 29 13:33:45.909222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 147/308] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:45 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:46.473665 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-894bea5b-14b7-491f-816a-3034ec44010e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:46.474679 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-894bea5b-14b7-491f-816a-3034ec44010e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:46.480519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-894bea5b-14b7-491f-816a-3034ec44010e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.480983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-894bea5b-14b7-491f-816a-3034ec44010e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.481719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-894bea5b-14b7-491f-816a-3034ec44010e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.482173 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-894bea5b-14b7-491f-816a-3034ec44010e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.606197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:46.606797 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:46.607479 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-894bea5b-14b7-491f-816a-3034ec44010e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 27555 microversion: 2.20 time: 0.137636 Oct 29 13:33:46.608134 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 162/309] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:46 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 27555 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:46.613003 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.613454 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.614271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.614707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.732931 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:46.740230 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9f4aa9a5-5465-4537-a504-597141e2aa68 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.137815 Oct 29 13:33:46.740785 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 148/310] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:46 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:46.785050 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-693f8b12-9116-48ae-8372-7c9b23fbb5dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:46.786066 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-693f8b12-9116-48ae-8372-7c9b23fbb5dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:46.792643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-693f8b12-9116-48ae-8372-7c9b23fbb5dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.793088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-693f8b12-9116-48ae-8372-7c9b23fbb5dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.794140 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-693f8b12-9116-48ae-8372-7c9b23fbb5dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.794574 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-693f8b12-9116-48ae-8372-7c9b23fbb5dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.815770 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:46.816397 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:46.822637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.823084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.823902 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.824336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.878602 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-693f8b12-9116-48ae-8372-7c9b23fbb5dc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28167 microversion: 2.1 time: 0.097255 Oct 29 13:33:46.879479 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 163/311] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:46 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28167 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:46.926557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:46.927252 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: 9ab4df17-6782-4400-9af8-87a1f8748e11] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:46.933641 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.934116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.934883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:46.935320 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:46.945884 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:46.949179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] HTTP exception thrown: Instance 9ab4df17-6782-4400-9af8-87a1f8748e11 could not be found. Oct 29 13:33:46.949787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Returning 404 to user: Instance 9ab4df17-6782-4400-9af8-87a1f8748e11 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:33:46.950610 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-30618181-b0c3-4f89-b327-1c7cf26edfa7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11" status: 404 len: 111 microversion: 2.1 time: 0.028128 Oct 29 13:33:46.951149 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 164/312] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:46 2021] GET /compute/v2.1/servers/9ab4df17-6782-4400-9af8-87a1f8748e11 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:33:46.953024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c35bb171-b955-4543-a95a-13d0657868b1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.141688 Oct 29 13:33:46.953868 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 149/313] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:46 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:47.043377 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-43071927", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "b27e33da-cc30-49c2-a24f-11585bfb590e"}]}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:47.093934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] validate_networks() for [('b27e33da-cc30-49c2-a24f-11585bfb590e', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:33:47.453696 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:33:47.454164 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:33:47.454635 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:33:47.455041 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:33:47.455450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:33:47.463875 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.464323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:47.465117 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.465552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:47.481680 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Getting quotas for project a87916e4d46b448baf2db17e63eab5d7. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:33:47.486185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Getting quotas for user 3c02a63b164645c39077937cea7e0991 and project a87916e4d46b448baf2db17e63eab5d7. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:33:47.496692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:33:47.499267 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:33:47.545685 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1d06de1b-7ecd-4b1c-b73f-2ecd463fa78d tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505972 Oct 29 13:33:47.547167 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 165/314] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:33:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:33:47.556717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4e5c0708-731f-4129-885a-604903f59235 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:47.557321 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4e5c0708-731f-4129-885a-604903f59235 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:47.608560 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4e5c0708-731f-4129-885a-604903f59235 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:47.615557 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4e5c0708-731f-4129-885a-604903f59235 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1212 microversion: 2.1 time: 0.062259 Oct 29 13:33:47.616278 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 150/315] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:47 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1212 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:47.619209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1efff948-5709-40ae-b5a6-7fd4b739bb5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:47.620437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1efff948-5709-40ae-b5a6-7fd4b739bb5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:47.627219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1efff948-5709-40ae-b5a6-7fd4b739bb5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.627674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1efff948-5709-40ae-b5a6-7fd4b739bb5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:47.628471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1efff948-5709-40ae-b5a6-7fd4b739bb5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.628906 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1efff948-5709-40ae-b5a6-7fd4b739bb5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:47.758138 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:47.758743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:47.764434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.765459 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:47.766160 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.766602 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:47.893742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:47.901302 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5769353c-d739-4f0b-ada3-76164b491243 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.146940 Oct 29 13:33:47.901873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 151/316] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:47 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:47.906794 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-983a1dfc-7f57-4636-bbc4-87783dc0f51a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:47.907738 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-983a1dfc-7f57-4636-bbc4-87783dc0f51a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:47.912898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-983a1dfc-7f57-4636-bbc4-87783dc0f51a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.913336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-983a1dfc-7f57-4636-bbc4-87783dc0f51a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:47.914121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-983a1dfc-7f57-4636-bbc4-87783dc0f51a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:47.914547 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-983a1dfc-7f57-4636-bbc4-87783dc0f51a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:48.940131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1efff948-5709-40ae-b5a6-7fd4b739bb5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 27731 microversion: 2.20 time: 1.324758 Oct 29 13:33:48.940774 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 166/317] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:47 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 27731 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:48.945518 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:48.946235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:48.952568 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:48.953018 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:48.953809 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:48.954249 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:49.079735 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:49.087169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8e9bbeba-84a4-484d-a85e-be9fa9c06fa0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.145250 Oct 29 13:33:49.087735 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 167/318] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:48 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:49.091923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:49.092519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:49.098523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:49.098972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:49.099736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:49.100169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:49.158607 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:49.166972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-be8e391c-7b45-4bea-a701-2a3f83643c97 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1216 microversion: 2.1 time: 0.078041 Oct 29 13:33:49.167670 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 168/319] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:49 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1216 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:49.172111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:49.172702 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:49.179263 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:49.179705 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:49.180467 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:49.180896 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:49.299016 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:49.306247 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-09005d17-4b57-4bee-875c-0698241f28a5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.137592 Oct 29 13:33:49.306800 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 169/320] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:49 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:49.951398 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-af68cc41-f7ea-4593-bdfb-ce144e9feaaf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:49.952304 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-af68cc41-f7ea-4593-bdfb-ce144e9feaaf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:49.958436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-af68cc41-f7ea-4593-bdfb-ce144e9feaaf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:49.958876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-af68cc41-f7ea-4593-bdfb-ce144e9feaaf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:49.959634 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-af68cc41-f7ea-4593-bdfb-ce144e9feaaf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:49.960056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-af68cc41-f7ea-4593-bdfb-ce144e9feaaf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:50.967941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-983a1dfc-7f57-4636-bbc4-87783dc0f51a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28167 microversion: 2.1 time: 3.064822 Oct 29 13:33:50.968590 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 152/321] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:47 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28167 bytes in 3066 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:50.973962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:50.974662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:50.981214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:50.981664 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:50.982473 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:50.982910 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:51.042545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-af68cc41-f7ea-4593-bdfb-ce144e9feaaf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 27986 microversion: 2.20 time: 1.094523 Oct 29 13:33:51.046374 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 170/322] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:49 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 27986 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:51.049035 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:51.049726 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:51.056128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:51.056577 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:51.057408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:51.057869 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:51.118576 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:51.123577 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:51.126315 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2edf365e-6b9d-4efe-bd40-4b56be1f09ec tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1208 microversion: 2.1 time: 0.081630 Oct 29 13:33:51.126878 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 171/323] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:51 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1208 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:51.131802 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:51.131964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bcb87200-19e0-4bb5-a05f-32667faa7557 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1318 microversion: 2.1 time: 0.161712 Oct 29 13:33:51.132527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 153/324] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:50 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:51.132798 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:51.140822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:51.141322 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:51.142194 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:51.142778 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:51.277063 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:51.284879 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c1fd4582-6a94-46a8-b708-242cad96df8d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.157075 Oct 29 13:33:51.285441 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 172/325] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:51 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:51.980113 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-59a15058-eff4-436f-ac1d-54fc5418bdc2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:51.981116 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-59a15058-eff4-436f-ac1d-54fc5418bdc2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:51.987349 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59a15058-eff4-436f-ac1d-54fc5418bdc2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:51.987878 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59a15058-eff4-436f-ac1d-54fc5418bdc2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:51.988655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59a15058-eff4-436f-ac1d-54fc5418bdc2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:51.989092 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-59a15058-eff4-436f-ac1d-54fc5418bdc2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.054414 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5b95d77c-d981-4206-b7fe-f03442ad28a1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:52.055248 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5b95d77c-d981-4206-b7fe-f03442ad28a1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:52.061378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5b95d77c-d981-4206-b7fe-f03442ad28a1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.061856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5b95d77c-d981-4206-b7fe-f03442ad28a1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.062618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5b95d77c-d981-4206-b7fe-f03442ad28a1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.063602 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5b95d77c-d981-4206-b7fe-f03442ad28a1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.082127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-59a15058-eff4-436f-ac1d-54fc5418bdc2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28167 microversion: 2.1 time: 0.105440 Oct 29 13:33:52.082947 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 154/326] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:51 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28167 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:52.144015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:52.144716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:52.151353 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.151798 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.152572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.153004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.181520 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5b95d77c-d981-4206-b7fe-f03442ad28a1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28154 microversion: 2.20 time: 0.130709 Oct 29 13:33:52.185672 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 173/327] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:52 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28154 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:52.188591 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:52.189287 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:52.195789 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.196237 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.197006 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.197441 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.218984 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:52.226647 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e7f50a3b-870b-43ce-82c0-cf6506f676c6 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1270 microversion: 2.1 time: 0.086834 Oct 29 13:33:52.227620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 155/328] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:52 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:52.301911 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:52.302526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:52.308627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.309007 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.309805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:52.310234 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:52.324131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:52.332237 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-63064e24-8f59-49c0-9c17-3df64deab8fa tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1507 microversion: 2.1 time: 0.147910 Oct 29 13:33:52.333498 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 174/329] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:52 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:52.499018 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:52.506712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-87b143e5-5946-41fb-a97e-34c65e7c0537 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.208457 Oct 29 13:33:52.507304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 156/330] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:52 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:33:53.093895 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-98a97ef0-844a-43a6-a591-5cb6930fd948 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:53.095439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-98a97ef0-844a-43a6-a591-5cb6930fd948 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:53.101205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98a97ef0-844a-43a6-a591-5cb6930fd948 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:53.101652 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98a97ef0-844a-43a6-a591-5cb6930fd948 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:53.102452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98a97ef0-844a-43a6-a591-5cb6930fd948 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:53.102890 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-98a97ef0-844a-43a6-a591-5cb6930fd948 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:53.192995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4edc245f-4fc8-4ad3-8a17-88dc937b87b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:53.193969 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4edc245f-4fc8-4ad3-8a17-88dc937b87b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:53.200109 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4edc245f-4fc8-4ad3-8a17-88dc937b87b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:53.200546 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4edc245f-4fc8-4ad3-8a17-88dc937b87b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:53.201308 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4edc245f-4fc8-4ad3-8a17-88dc937b87b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:53.201736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4edc245f-4fc8-4ad3-8a17-88dc937b87b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:55.591118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4edc245f-4fc8-4ad3-8a17-88dc937b87b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28154 microversion: 2.20 time: 2.401656 Oct 29 13:33:55.596080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 157/331] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:53 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28154 bytes in 2408 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:33:55.598497 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-98a97ef0-844a-43a6-a591-5cb6930fd948 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28167 microversion: 2.1 time: 2.508042 Oct 29 13:33:55.602921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 175/332] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:53 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28167 bytes in 2510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:33:55.603060 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:55.603060 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:55.606520 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:55.607282 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:55.608446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:55.608902 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:55.610732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:55.610846 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:55.617956 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:55.618401 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:55.619164 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:55.619586 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:55.745345 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:55.755621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d475312c-682b-4290-880d-47631c602c83 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.155140 Oct 29 13:33:55.756543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 176/333] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:55 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:55.863854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:55.871831 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-57ab233d-a975-43a0-9853-ac76d955b5ef tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.274488 Oct 29 13:33:55.872395 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 158/334] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:55 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:56.222766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-21438a9b-867c-4119-afd1-1c54a78ed22e req-06b82b35-cea3-4473-984f-56fff3834400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ffcd6c-b28c-4d6e-a492-f97a530a91a4", "tag": "30cf5780-dc09-4a86-8efb-1992e21fa972"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:56.225062 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:33:56.225062 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:33:56.233575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-21438a9b-867c-4119-afd1-1c54a78ed22e req-06b82b35-cea3-4473-984f-56fff3834400 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.234146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-21438a9b-867c-4119-afd1-1c54a78ed22e req-06b82b35-cea3-4473-984f-56fff3834400 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.251467 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-21438a9b-867c-4119-afd1-1c54a78ed22e req-06b82b35-cea3-4473-984f-56fff3834400 service nova] Creating event network-changed:30cf5780-dc09-4a86-8efb-1992e21fa972 for instance d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 on hv-cinder-81588 Oct 29 13:33:56.256226 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-21438a9b-867c-4119-afd1-1c54a78ed22e req-06b82b35-cea3-4473-984f-56fff3834400 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039163 Oct 29 13:33:56.256809 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 177/335] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:33:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:33:56.603270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6c2e5021-14b4-4504-868c-f7de7744f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:56.604232 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6c2e5021-14b4-4504-868c-f7de7744f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:56.610685 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c2e5021-14b4-4504-868c-f7de7744f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.610879 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ff4b2c6d-891b-4b95-90ee-cf0730db418a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:56.611289 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c2e5021-14b4-4504-868c-f7de7744f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.611736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ff4b2c6d-891b-4b95-90ee-cf0730db418a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:56.611866 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c2e5021-14b4-4504-868c-f7de7744f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.612281 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c2e5021-14b4-4504-868c-f7de7744f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.618195 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff4b2c6d-891b-4b95-90ee-cf0730db418a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.618638 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff4b2c6d-891b-4b95-90ee-cf0730db418a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.619406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff4b2c6d-891b-4b95-90ee-cf0730db418a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.619846 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff4b2c6d-891b-4b95-90ee-cf0730db418a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.722115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6c2e5021-14b4-4504-868c-f7de7744f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28154 microversion: 2.20 time: 0.122319 Oct 29 13:33:56.726002 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 159/336] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:56 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28154 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:33:56.736995 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ff4b2c6d-891b-4b95-90ee-cf0730db418a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28167 microversion: 2.1 time: 0.130041 Oct 29 13:33:56.738233 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 178/337] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:56 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28167 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:33:56.772698 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:56.773398 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:56.780961 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.781646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.782627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.783065 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.822962 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3f2b3add-f6de-4ae1-bd26-7c8a0be62c6a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88129648-ee78-4d7e-8992-204339cfc012"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:56.824309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3f2b3add-f6de-4ae1-bd26-7c8a0be62c6a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:56.831675 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2b3add-f6de-4ae1-bd26-7c8a0be62c6a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.832668 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2b3add-f6de-4ae1-bd26-7c8a0be62c6a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:56.833626 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2b3add-f6de-4ae1-bd26-7c8a0be62c6a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:56.834229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2b3add-f6de-4ae1-bd26-7c8a0be62c6a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:57.115579 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3f2b3add-f6de-4ae1-bd26-7c8a0be62c6a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302373 Oct 29 13:33:57.116297 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 179/338] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:33:56 2021] POST /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:33:57.122828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:33:57.123851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:57.134016 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:57.134582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:57.135601 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:57.136219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:57.260707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:57.271915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-602937ec-3969-41af-92dc-0de30b6ee2b0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.503173 Oct 29 13:33:57.272492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 160/339] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:56 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:57.285044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:33:57.292519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3dabb76b-3ed5-450a-8422-32dbf2860254 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.174981 Oct 29 13:33:57.293071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 180/340] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:33:57 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:33:57.733684 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fa9926eb-5340-4b09-8755-6608ce5c529d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:57.734564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fa9926eb-5340-4b09-8755-6608ce5c529d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:57.740838 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9926eb-5340-4b09-8755-6608ce5c529d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:57.741274 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9926eb-5340-4b09-8755-6608ce5c529d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:57.742064 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9926eb-5340-4b09-8755-6608ce5c529d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:57.742498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9926eb-5340-4b09-8755-6608ce5c529d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:57.748867 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-231fc793-0dc8-400d-83cd-0c4791f343bd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:33:57.750148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-231fc793-0dc8-400d-83cd-0c4791f343bd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:33:57.757272 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-231fc793-0dc8-400d-83cd-0c4791f343bd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:57.757725 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-231fc793-0dc8-400d-83cd-0c4791f343bd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:33:57.758530 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-231fc793-0dc8-400d-83cd-0c4791f343bd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:33:57.758963 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-231fc793-0dc8-400d-83cd-0c4791f343bd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:00.775617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fa9926eb-5340-4b09-8755-6608ce5c529d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28154 microversion: 2.20 time: 3.045525 Oct 29 13:34:00.776280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 161/341] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:33:57 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28154 bytes in 3047 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:00.781434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c1974393-d389-4641-bb9e-8e18cfef5654 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f0b6833-bf96-47d4-8016-6d83eb9a2ad0", "device": "/dev/sdb"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:00.783068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c1974393-d389-4641-bb9e-8e18cfef5654 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:00.789676 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c1974393-d389-4641-bb9e-8e18cfef5654 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:00.790154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c1974393-d389-4641-bb9e-8e18cfef5654 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:00.790931 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c1974393-d389-4641-bb9e-8e18cfef5654 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:00.791390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c1974393-d389-4641-bb9e-8e18cfef5654 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:00.800909 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-231fc793-0dc8-400d-83cd-0c4791f343bd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28458 microversion: 2.1 time: 3.056197 Oct 29 13:34:00.804774 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 181/342] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:33:57 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28458 bytes in 3058 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:00.806789 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:00.807482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:00.814537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:00.814988 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:00.815759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:00.816194 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:00.939991 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:00.948545 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-35331bf4-39f7-4a14-bfed-8da5563ab481 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.145339 Oct 29 13:34:00.949036 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 182/343] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:00 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:00.953189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:00.954394 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:00.960004 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:00.960451 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:00.961218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:00.961658 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:01.041693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c1974393-d389-4641-bb9e-8e18cfef5654 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "POST /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263921 Oct 29 13:34:01.042645 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 162/344] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:34:00 2021] POST /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:01.093269 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:01.101058 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-bbd14a3a-92a8-4670-a391-1f6f47b44717 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.151062 Oct 29 13:34:01.101698 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 183/345] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:00 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:01.787753 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d2738ab4-a2a8-4f4e-920e-8d7f374f4f2d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:01.788815 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d2738ab4-a2a8-4f4e-920e-8d7f374f4f2d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:01.794802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d2738ab4-a2a8-4f4e-920e-8d7f374f4f2d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:01.795247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d2738ab4-a2a8-4f4e-920e-8d7f374f4f2d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:01.796013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d2738ab4-a2a8-4f4e-920e-8d7f374f4f2d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:01.796448 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d2738ab4-a2a8-4f4e-920e-8d7f374f4f2d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:01.812164 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6b35e88a-72ec-46ad-b17f-e108c96dbce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:01.813783 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6b35e88a-72ec-46ad-b17f-e108c96dbce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:01.819830 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b35e88a-72ec-46ad-b17f-e108c96dbce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:01.820275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b35e88a-72ec-46ad-b17f-e108c96dbce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:01.821043 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b35e88a-72ec-46ad-b17f-e108c96dbce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:01.821482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b35e88a-72ec-46ad-b17f-e108c96dbce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:01.886776 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d2738ab4-a2a8-4f4e-920e-8d7f374f4f2d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28154 microversion: 2.20 time: 0.102975 Oct 29 13:34:01.890550 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 163/346] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:01 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28154 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:01.965989 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:01.966685 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:01.973136 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:01.973583 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:01.974381 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:01.974815 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:02.094679 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:02.101732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2e4e805f-fb7c-4aa6-8260-da8cb2aea347 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.139763 Oct 29 13:34:02.102320 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 164/347] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:01 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:02.117689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:02.118323 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:02.124224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:02.124640 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:02.125992 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:02.126579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:02.201738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6b35e88a-72ec-46ad-b17f-e108c96dbce4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28458 microversion: 2.1 time: 0.392972 Oct 29 13:34:02.202425 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 184/348] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:01 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28458 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:02.251540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:02.259077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bfe5dc36-c676-423b-bae3-c2aff81b1665 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.144807 Oct 29 13:34:02.259641 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 165/349] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:02 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:02.898483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-664584d1-42ff-4ce2-936a-f59ad26101a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:02.899495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-664584d1-42ff-4ce2-936a-f59ad26101a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:02.905800 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-664584d1-42ff-4ce2-936a-f59ad26101a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:02.906242 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-664584d1-42ff-4ce2-936a-f59ad26101a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:02.906993 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-664584d1-42ff-4ce2-936a-f59ad26101a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:02.907415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-664584d1-42ff-4ce2-936a-f59ad26101a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:02.991593 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-664584d1-42ff-4ce2-936a-f59ad26101a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28154 microversion: 2.20 time: 0.096932 Oct 29 13:34:02.992203 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 185/350] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:02 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28154 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:03.118667 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:03.119303 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:03.126268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:03.126708 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:03.127457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:03.127881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:03.214165 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f2642dac-1499-4f41-9e8c-e3a5baa218a4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:03.215189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f2642dac-1499-4f41-9e8c-e3a5baa218a4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:03.221227 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2642dac-1499-4f41-9e8c-e3a5baa218a4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:03.221705 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2642dac-1499-4f41-9e8c-e3a5baa218a4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:03.222491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2642dac-1499-4f41-9e8c-e3a5baa218a4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:03.222919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2642dac-1499-4f41-9e8c-e3a5baa218a4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:03.253222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:03.260476 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b7b1bdb7-8b39-4a1a-a9af-66532d7a3110 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1521 microversion: 2.1 time: 0.145486 Oct 29 13:34:03.261040 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 166/351] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:03 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:03.275115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:03.275709 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:03.281090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:03.281561 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:03.282359 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:03.282784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:03.337415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f2642dac-1499-4f41-9e8c-e3a5baa218a4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.127090 Oct 29 13:34:03.341642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 186/352] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:03 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:03.405520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:03.412699 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7da53bf2-0165-447e-96d9-2bb4f67e210b tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.140950 Oct 29 13:34:03.413255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 167/353] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:03 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:04.003880 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e5cd492a-f91f-46da-9dc5-4a49a66dab96 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:04.004820 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e5cd492a-f91f-46da-9dc5-4a49a66dab96 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:04.011051 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cd492a-f91f-46da-9dc5-4a49a66dab96 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.011486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cd492a-f91f-46da-9dc5-4a49a66dab96 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.012241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cd492a-f91f-46da-9dc5-4a49a66dab96 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.012663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cd492a-f91f-46da-9dc5-4a49a66dab96 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.098727 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e5cd492a-f91f-46da-9dc5-4a49a66dab96 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28154 microversion: 2.20 time: 0.099384 Oct 29 13:34:04.099720 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 187/354] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:03 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28154 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:04.277441 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:04.278091 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:04.283721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.284170 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.284941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.285376 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.348946 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6c2139b7-c5ed-4f5a-8839-3c426e2585fc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:04.349990 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6c2139b7-c5ed-4f5a-8839-3c426e2585fc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:04.356198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c2139b7-c5ed-4f5a-8839-3c426e2585fc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.356640 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c2139b7-c5ed-4f5a-8839-3c426e2585fc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.357413 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c2139b7-c5ed-4f5a-8839-3c426e2585fc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.358245 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c2139b7-c5ed-4f5a-8839-3c426e2585fc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.407075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:04.414537 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f2b27b80-ce8b-4c1c-8a27-f25b85ed6003 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1501 microversion: 2.1 time: 0.140677 Oct 29 13:34:04.415206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 168/355] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:04 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1501 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:04.428895 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:04.429501 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:04.435234 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.435682 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.436444 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.436880 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.454586 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6c2139b7-c5ed-4f5a-8839-3c426e2585fc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.109435 Oct 29 13:34:04.458526 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 188/356] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:04 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:04.460285 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:04.460981 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:04.467088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.467536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.468304 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:04.468738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:04.558963 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:04.565959 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e496c023-9f20-429c-a429-26b0731693cd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.140481 Oct 29 13:34:04.566520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 169/357] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:04 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:04.600352 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:04.607702 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ffa7a317-6890-40e1-a7f0-805bfe813216 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1515 microversion: 2.1 time: 0.151386 Oct 29 13:34:04.608262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 189/358] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:04 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:05.110451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-23624975-7267-40e7-a57f-776636439c0d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:05.111421 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-23624975-7267-40e7-a57f-776636439c0d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:05.117058 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23624975-7267-40e7-a57f-776636439c0d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.117500 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23624975-7267-40e7-a57f-776636439c0d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.118299 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23624975-7267-40e7-a57f-776636439c0d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.118731 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23624975-7267-40e7-a57f-776636439c0d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.226326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-23624975-7267-40e7-a57f-776636439c0d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28169 microversion: 2.20 time: 0.119319 Oct 29 13:34:05.226959 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 170/359] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:05 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28169 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:05.466313 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-aae39c9b-11bd-4a5b-8f21-d78dcc32b975 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:05.467126 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-aae39c9b-11bd-4a5b-8f21-d78dcc32b975 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:05.473181 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aae39c9b-11bd-4a5b-8f21-d78dcc32b975 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.473618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aae39c9b-11bd-4a5b-8f21-d78dcc32b975 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.474400 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aae39c9b-11bd-4a5b-8f21-d78dcc32b975 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.474828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aae39c9b-11bd-4a5b-8f21-d78dcc32b975 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.582925 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-aae39c9b-11bd-4a5b-8f21-d78dcc32b975 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.120248 Oct 29 13:34:05.583238 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:05.583683 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 190/360] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:05 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:05.583967 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:05.590727 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.591175 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.591950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.592384 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.719270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:05.726478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2837f999-6717-4a72-90c6-11991775d6dd tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.147460 Oct 29 13:34:05.727044 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 171/361] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:05 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:05.784023 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-b07b69ca-ea8f-40bb-9289-7993772d8638 req-ebe43f9b-4d8e-45f8-bf29-b6e4e7208ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ffcd6c-b28c-4d6e-a492-f97a530a91a4", "name": "network-vif-plugged", "status": "completed", "tag": "30cf5780-dc09-4a86-8efb-1992e21fa972"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:05.785505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:34:05.785505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:34:05.793155 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-b07b69ca-ea8f-40bb-9289-7993772d8638 req-ebe43f9b-4d8e-45f8-bf29-b6e4e7208ebd service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.793593 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-b07b69ca-ea8f-40bb-9289-7993772d8638 req-ebe43f9b-4d8e-45f8-bf29-b6e4e7208ebd service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.804985 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-b07b69ca-ea8f-40bb-9289-7993772d8638 req-ebe43f9b-4d8e-45f8-bf29-b6e4e7208ebd service nova] Creating event network-vif-plugged:30cf5780-dc09-4a86-8efb-1992e21fa972 for instance d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 on hv-cinder-81588 Oct 29 13:34:05.809579 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-b07b69ca-ea8f-40bb-9289-7993772d8638 req-ebe43f9b-4d8e-45f8-bf29-b6e4e7208ebd service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030915 Oct 29 13:34:05.810184 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 191/362] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:34:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:05.950994 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:05.951923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:05.958004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.958472 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.959222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:05.959659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:05.982662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lazy-loading 'flavor' on Instance uuid e36bbf99-9c28-4d21-b72b-a31707096ce3 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:34:06.097741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7d899d10-d7bc-4d5d-b910-6f99647fadb5 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action" status: 200 len: 32 microversion: 2.1 time: 0.151448 Oct 29 13:34:06.102668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 172/363] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:05 2021] POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:34:06.108254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:06.109067 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:06.116920 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.117487 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.118622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.119060 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.239740 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-eed7290a-8824-4e07-81ac-53ff332bf78c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:06.240813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-eed7290a-8824-4e07-81ac-53ff332bf78c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:06.246923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eed7290a-8824-4e07-81ac-53ff332bf78c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.247369 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eed7290a-8824-4e07-81ac-53ff332bf78c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.248482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eed7290a-8824-4e07-81ac-53ff332bf78c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.248919 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eed7290a-8824-4e07-81ac-53ff332bf78c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.250457 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:06.257618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2c63aa68-2f6c-464d-ae35-3a781bebad31 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.153522 Oct 29 13:34:06.258208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 192/364] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:06 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:06.442352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-eed7290a-8824-4e07-81ac-53ff332bf78c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28443 microversion: 2.20 time: 0.207187 Oct 29 13:34:06.443707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 173/365] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:06 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28443 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:06.595071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0ba94e68-061e-496c-9580-5f4c8170a24b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:06.595989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0ba94e68-061e-496c-9580-5f4c8170a24b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:06.601934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0ba94e68-061e-496c-9580-5f4c8170a24b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.602384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0ba94e68-061e-496c-9580-5f4c8170a24b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.603148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0ba94e68-061e-496c-9580-5f4c8170a24b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.603584 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0ba94e68-061e-496c-9580-5f4c8170a24b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.744187 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:06.744882 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:06.752684 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.753169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.753945 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:06.754437 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:06.757278 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0ba94e68-061e-496c-9580-5f4c8170a24b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.166219 Oct 29 13:34:06.761141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 193/366] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:06 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:06.946501 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:06.954171 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6decbd7b-66df-4a63-a754-51a6fda5f0a4 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.213407 Oct 29 13:34:06.954739 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 174/367] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:06 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:07.274453 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:07.275174 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:07.281514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.282006 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:07.282771 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.283202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:07.410777 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:07.419234 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-826a1989-678e-420b-a8a5-813e1258ba3a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.148691 Oct 29 13:34:07.419854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 194/368] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:07 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:07.454333 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-442c2d36-e816-4999-8988-1ea7bb5d77b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:07.455282 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-442c2d36-e816-4999-8988-1ea7bb5d77b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:07.461202 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-442c2d36-e816-4999-8988-1ea7bb5d77b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.461649 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-442c2d36-e816-4999-8988-1ea7bb5d77b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:07.462455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-442c2d36-e816-4999-8988-1ea7bb5d77b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.462888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-442c2d36-e816-4999-8988-1ea7bb5d77b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:07.554300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-442c2d36-e816-4999-8988-1ea7bb5d77b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28443 microversion: 2.20 time: 0.103916 Oct 29 13:34:07.558200 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 175/369] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:07 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:07.769739 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2f86113a-62d7-4aba-a542-5fa2fada0aa3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:07.770701 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2f86113a-62d7-4aba-a542-5fa2fada0aa3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:07.776387 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f86113a-62d7-4aba-a542-5fa2fada0aa3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.776837 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f86113a-62d7-4aba-a542-5fa2fada0aa3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:07.777597 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f86113a-62d7-4aba-a542-5fa2fada0aa3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.778229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f86113a-62d7-4aba-a542-5fa2fada0aa3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:07.868786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2f86113a-62d7-4aba-a542-5fa2fada0aa3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.103144 Oct 29 13:34:07.869414 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 195/370] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:07 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:07.971755 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:07.972529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:07.983847 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.984296 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:07.985106 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:07.987790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.146127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:08.155941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a90006ff-6f45-49db-baf0-5d2fab458002 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1312 microversion: 2.1 time: 0.188814 Oct 29 13:34:08.156766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 176/371] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:07 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:08.437000 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:08.438241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:08.444844 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.445290 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.446150 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.446638 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.566485 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-484385f0-9f48-44c5-95a5-588269656162 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:08.567556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-484385f0-9f48-44c5-95a5-588269656162 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:08.571066 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:08.573549 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-484385f0-9f48-44c5-95a5-588269656162 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.574221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-484385f0-9f48-44c5-95a5-588269656162 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.575216 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-484385f0-9f48-44c5-95a5-588269656162 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.575651 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-484385f0-9f48-44c5-95a5-588269656162 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.579593 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0324b0e1-73a2-4857-a08b-3255d2565315 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.146643 Oct 29 13:34:08.581898 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 196/372] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:08 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:08.682294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-484385f0-9f48-44c5-95a5-588269656162 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.119945 Oct 29 13:34:08.682932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 177/373] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:08 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:08.870537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88129648-ee78-4d7e-8992-204339cfc012"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:08.871672 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:08.878350 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.878795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.879569 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.880003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.881276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-eb87d829-66ac-43f9-ab1b-eff6d45f9129 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:08.882317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-eb87d829-66ac-43f9-ab1b-eff6d45f9129 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:08.888575 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb87d829-66ac-43f9-ab1b-eff6d45f9129 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.889019 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb87d829-66ac-43f9-ab1b-eff6d45f9129 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.889804 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb87d829-66ac-43f9-ab1b-eff6d45f9129 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:08.890236 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb87d829-66ac-43f9-ab1b-eff6d45f9129 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:08.960357 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] HTTP exception thrown: Invalid volume: volume 88129648-ee78-4d7e-8992-204339cfc012 is already attached to instances: 9bccbf8d-3727-4704-abe1-27a1f8130529 Oct 29 13:34:08.960946 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Returning 400 to user: Invalid volume: volume 88129648-ee78-4d7e-8992-204339cfc012 is already attached to instances: 9bccbf8d-3727-4704-abe1-27a1f8130529 {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:34:08.961851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-68c78377-05f3-41fd-aab0-6558c6438192 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095166 Oct 29 13:34:08.962386 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 197/374] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:34:08 2021] POST /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 29 13:34:08.983838 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-eb87d829-66ac-43f9-ab1b-eff6d45f9129 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.106220 Oct 29 13:34:08.984372 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 178/375] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:08 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:09.024493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:09.024923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:09.031145 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.031595 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.032360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.032793 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.158244 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lazy-loading 'services' on Instance uuid 9bccbf8d-3727-4704-abe1-27a1f8130529 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:34:09.174075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:09.176707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:09.183028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.183484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.184140 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.184575 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.264067 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2b033c04-f873-42ec-813e-e8ded6348556 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments/88129648-ee78-4d7e-8992-204339cfc012" status: 202 len: 0 microversion: 2.1 time: 0.243173 Oct 29 13:34:09.264646 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 198/376] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:34:09 2021] DELETE /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments/88129648-ee78-4d7e-8992-204339cfc012 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:09.273437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d51c0d35-790e-4567-aed9-1625023a3a45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:09.274564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d51c0d35-790e-4567-aed9-1625023a3a45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:09.280496 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d51c0d35-790e-4567-aed9-1625023a3a45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.280939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d51c0d35-790e-4567-aed9-1625023a3a45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.281725 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d51c0d35-790e-4567-aed9-1625023a3a45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.282210 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d51c0d35-790e-4567-aed9-1625023a3a45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.312527 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d51c0d35-790e-4567-aed9-1625023a3a45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042890 Oct 29 13:34:09.313746 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 199/377] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:09 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:09.318184 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:09.325472 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0addfc6e-15e5-486a-8c77-e277be172a02 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1495 microversion: 2.1 time: 0.155461 Oct 29 13:34:09.326049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 179/378] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:09 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:09.596022 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:09.596624 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:09.602698 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.603146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.603906 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.604338 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.692781 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f1fd9029-2a75-43b8-8805-62b056c0814d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:09.693694 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f1fd9029-2a75-43b8-8805-62b056c0814d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:09.699630 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f1fd9029-2a75-43b8-8805-62b056c0814d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.700074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f1fd9029-2a75-43b8-8805-62b056c0814d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.700845 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f1fd9029-2a75-43b8-8805-62b056c0814d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.701273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f1fd9029-2a75-43b8-8805-62b056c0814d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.728791 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:09.737059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a43af87c-2f80-4e7d-931e-e54b9e2f6878 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.144747 Oct 29 13:34:09.737622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 200/379] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:09 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:09.796198 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f1fd9029-2a75-43b8-8805-62b056c0814d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.106863 Oct 29 13:34:09.798053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 180/380] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:09 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:09.850534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:09.851027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:09.856710 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.857154 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.857951 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.858387 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.883069 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:34:09.953092 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c10b090f-967b-4f92-b2c5-6cb282adc643 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "DELETE /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 204 len: 0 microversion: 2.1 time: 0.105855 Oct 29 13:34:09.953865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 201/381] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:34:09 2021] DELETE /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:34:09.962297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:09.962987 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:09.969733 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.970206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.970968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:09.971393 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:09.995854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a96b4509-acf8-4714-afea-d0b3f710f8b6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:09.996958 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a96b4509-acf8-4714-afea-d0b3f710f8b6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:10.002975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a96b4509-acf8-4714-afea-d0b3f710f8b6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.003421 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a96b4509-acf8-4714-afea-d0b3f710f8b6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.004187 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a96b4509-acf8-4714-afea-d0b3f710f8b6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.004621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a96b4509-acf8-4714-afea-d0b3f710f8b6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.080700 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a96b4509-acf8-4714-afea-d0b3f710f8b6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.088640 Oct 29 13:34:10.081384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 202/382] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:09 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:10.093169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:10.100883 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-78afdf2c-6497-4068-9d48-b256e9b6dbc8 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1501 microversion: 2.1 time: 0.142625 Oct 29 13:34:10.101431 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 181/383] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:09 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1501 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:10.324990 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0e947802-4748-4b1a-bb78-3db804ee511d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:10.325946 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0e947802-4748-4b1a-bb78-3db804ee511d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:10.332885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0e947802-4748-4b1a-bb78-3db804ee511d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.333331 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0e947802-4748-4b1a-bb78-3db804ee511d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.334122 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0e947802-4748-4b1a-bb78-3db804ee511d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.334561 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0e947802-4748-4b1a-bb78-3db804ee511d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.363140 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0e947802-4748-4b1a-bb78-3db804ee511d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042404 Oct 29 13:34:10.363687 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 203/384] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:10 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:10.756010 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:10.756616 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:10.762470 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.762920 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.763688 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.764120 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.808136 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-621f5a4c-97c9-4884-a079-6da1d23f2d16 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:10.809027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-621f5a4c-97c9-4884-a079-6da1d23f2d16 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:10.815650 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-621f5a4c-97c9-4884-a079-6da1d23f2d16 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.816081 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-621f5a4c-97c9-4884-a079-6da1d23f2d16 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.816834 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-621f5a4c-97c9-4884-a079-6da1d23f2d16 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:10.817558 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-621f5a4c-97c9-4884-a079-6da1d23f2d16 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:10.887660 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:10.895103 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-06d90704-2d77-4891-94e9-cf5eadbbe159 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.143692 Oct 29 13:34:10.895663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 182/385] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:10 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:10.897147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-621f5a4c-97c9-4884-a079-6da1d23f2d16 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.092376 Oct 29 13:34:10.897839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 204/386] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:10 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:11.091824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-42bca0f5-64e3-4c98-a088-a0106a5b7a82 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:11.092804 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-42bca0f5-64e3-4c98-a088-a0106a5b7a82 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:11.099047 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-42bca0f5-64e3-4c98-a088-a0106a5b7a82 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.099607 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-42bca0f5-64e3-4c98-a088-a0106a5b7a82 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.100159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-42bca0f5-64e3-4c98-a088-a0106a5b7a82 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.100581 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-42bca0f5-64e3-4c98-a088-a0106a5b7a82 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.118850 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:11.119674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:11.126525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.126964 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.127729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.128205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.183120 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-42bca0f5-64e3-4c98-a088-a0106a5b7a82 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.094899 Oct 29 13:34:11.183770 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 183/387] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:11 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:11.254347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:11.261475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6c35fbbe-0c3a-40e0-91ce-740bc8702eb7 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1501 microversion: 2.1 time: 0.148018 Oct 29 13:34:11.262065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 205/388] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:11 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:11.375325 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8b7bfb7d-447b-406e-9a65-6e78f17d2435 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:11.376324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8b7bfb7d-447b-406e-9a65-6e78f17d2435 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:11.382675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8b7bfb7d-447b-406e-9a65-6e78f17d2435 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.383112 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8b7bfb7d-447b-406e-9a65-6e78f17d2435 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.383858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8b7bfb7d-447b-406e-9a65-6e78f17d2435 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.384279 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8b7bfb7d-447b-406e-9a65-6e78f17d2435 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.412408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8b7bfb7d-447b-406e-9a65-6e78f17d2435 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 Oct 29 13:34:11.412937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 184/389] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:11 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:11.909373 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f27f15e6-827c-44d1-b9ff-ae2ab5aba1ff tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:11.910294 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f27f15e6-827c-44d1-b9ff-ae2ab5aba1ff tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:11.911052 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:11.911657 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:11.916306 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f27f15e6-827c-44d1-b9ff-ae2ab5aba1ff tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.916775 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f27f15e6-827c-44d1-b9ff-ae2ab5aba1ff tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.917342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.917528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f27f15e6-827c-44d1-b9ff-ae2ab5aba1ff tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.917813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.917997 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f27f15e6-827c-44d1-b9ff-ae2ab5aba1ff tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:11.918586 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:11.919022 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.038197 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f27f15e6-827c-44d1-b9ff-ae2ab5aba1ff tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.132835 Oct 29 13:34:12.038828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 206/390] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:11 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:12.040329 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:12.048537 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2374c2a2-ec5d-48a9-b9ea-99638c07fbbb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.141122 Oct 29 13:34:12.049077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 185/391] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:11 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:12.195380 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a2dd3169-511c-4bcd-b3f6-905aa82abae5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:12.196402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a2dd3169-511c-4bcd-b3f6-905aa82abae5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:12.202724 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a2dd3169-511c-4bcd-b3f6-905aa82abae5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:12.203169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a2dd3169-511c-4bcd-b3f6-905aa82abae5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.203927 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a2dd3169-511c-4bcd-b3f6-905aa82abae5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:12.204360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a2dd3169-511c-4bcd-b3f6-905aa82abae5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.278394 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:12.279137 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:12.285914 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:12.286358 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.287114 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:12.287543 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.323748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a2dd3169-511c-4bcd-b3f6-905aa82abae5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.132158 Oct 29 13:34:12.324491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 207/392] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:12 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:12.424664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-124f2353-bdfb-414a-96e4-3e892cba190d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:12.425714 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-124f2353-bdfb-414a-96e4-3e892cba190d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:12.431951 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124f2353-bdfb-414a-96e4-3e892cba190d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:12.432396 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124f2353-bdfb-414a-96e4-3e892cba190d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.433156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124f2353-bdfb-414a-96e4-3e892cba190d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:12.433585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124f2353-bdfb-414a-96e4-3e892cba190d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.462690 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-124f2353-bdfb-414a-96e4-3e892cba190d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042580 Oct 29 13:34:12.463241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 208/393] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:12 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:12.467617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:12.474773 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0db20fab-b01a-4146-bead-4de54415cb14 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1501 microversion: 2.1 time: 0.200343 Oct 29 13:34:12.475317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 186/394] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:12 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1501 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:12.798056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-15c9e4a8-a6a2-4686-ae82-beb27433a243 req-28b3ae12-194f-4558-b53c-fc20204c31b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ffcd6c-b28c-4d6e-a492-f97a530a91a4", "name": "network-vif-deleted", "tag": "30cf5780-dc09-4a86-8efb-1992e21fa972"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:12.799656 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:34:12.799656 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:34:12.807793 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-15c9e4a8-a6a2-4686-ae82-beb27433a243 req-28b3ae12-194f-4558-b53c-fc20204c31b8 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:12.808236 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-15c9e4a8-a6a2-4686-ae82-beb27433a243 req-28b3ae12-194f-4558-b53c-fc20204c31b8 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:12.820441 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-15c9e4a8-a6a2-4686-ae82-beb27433a243 req-28b3ae12-194f-4558-b53c-fc20204c31b8 service nova] Creating event network-vif-deleted:30cf5780-dc09-4a86-8efb-1992e21fa972 for instance d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 on hv-cinder-81588 Oct 29 13:34:12.826221 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-15c9e4a8-a6a2-4686-ae82-beb27433a243 req-28b3ae12-194f-4558-b53c-fc20204c31b8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032733 Oct 29 13:34:12.826802 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 209/395] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:34:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:13.049964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c82f1107-0298-4c01-887b-592ab39b6a46 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:13.050780 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c82f1107-0298-4c01-887b-592ab39b6a46 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:13.056482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c82f1107-0298-4c01-887b-592ab39b6a46 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.056919 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c82f1107-0298-4c01-887b-592ab39b6a46 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.057668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c82f1107-0298-4c01-887b-592ab39b6a46 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.058116 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c82f1107-0298-4c01-887b-592ab39b6a46 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.064382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:13.065103 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:13.071266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.071772 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.072538 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.072973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.133420 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c82f1107-0298-4c01-887b-592ab39b6a46 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.087097 Oct 29 13:34:13.134267 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 187/396] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:13 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:13.192907 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:13.200096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e5cae643-4e5e-48c7-b192-09094401fd8a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.139635 Oct 29 13:34:13.200652 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 210/397] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:13 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:13.335438 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-783c3662-bd4b-472a-b5db-1eb2f4e43f7f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:13.336463 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-783c3662-bd4b-472a-b5db-1eb2f4e43f7f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:13.342884 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-783c3662-bd4b-472a-b5db-1eb2f4e43f7f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.343329 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-783c3662-bd4b-472a-b5db-1eb2f4e43f7f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.344724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-783c3662-bd4b-472a-b5db-1eb2f4e43f7f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.345156 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-783c3662-bd4b-472a-b5db-1eb2f4e43f7f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.423020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-783c3662-bd4b-472a-b5db-1eb2f4e43f7f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.091501 Oct 29 13:34:13.423617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 188/398] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:13 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:13.474122 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c237d206-ee68-4dea-9c5e-9caa989adb75 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:13.475308 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c237d206-ee68-4dea-9c5e-9caa989adb75 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:13.481464 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c237d206-ee68-4dea-9c5e-9caa989adb75 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.481949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c237d206-ee68-4dea-9c5e-9caa989adb75 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.482726 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c237d206-ee68-4dea-9c5e-9caa989adb75 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.483155 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c237d206-ee68-4dea-9c5e-9caa989adb75 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.497407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:13.498413 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:13.505662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.506238 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.507070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.507531 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.516875 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c237d206-ee68-4dea-9c5e-9caa989adb75 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046709 Oct 29 13:34:13.517648 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 211/399] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:13 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:13.541376 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:13.541849 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:13.542295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lazy-loading 'fault' on Instance uuid d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:34:13.582466 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c02a63b164645c39077937cea7e0991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a87916e4d46b448baf2db17e63eab5d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:13.589842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b6e7e3a2-86d9-47d8-a43c-7c4b80c18a32 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 200 len: 1302 microversion: 2.1 time: 0.101712 Oct 29 13:34:13.590672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 189/400] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:13 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:14.144982 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6cbe3527-6876-4c27-95c6-ef0ee3f56bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:14.145944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6cbe3527-6876-4c27-95c6-ef0ee3f56bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:14.151749 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cbe3527-6876-4c27-95c6-ef0ee3f56bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.152193 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cbe3527-6876-4c27-95c6-ef0ee3f56bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.152953 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cbe3527-6876-4c27-95c6-ef0ee3f56bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.153384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6cbe3527-6876-4c27-95c6-ef0ee3f56bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.216670 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:14.217291 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:14.223011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.223450 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.224200 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.224620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.233155 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6cbe3527-6876-4c27-95c6-ef0ee3f56bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.092204 Oct 29 13:34:14.235443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 212/401] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:14 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:14.343577 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:14.351336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bb342dfd-4db2-4438-bab6-9841518aeb2f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.138170 Oct 29 13:34:14.351913 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 190/402] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:14 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:14.435020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2080cd92-2823-4434-9797-026dfc046288 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:14.435929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2080cd92-2823-4434-9797-026dfc046288 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:14.442766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2080cd92-2823-4434-9797-026dfc046288 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.443211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2080cd92-2823-4434-9797-026dfc046288 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.444004 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2080cd92-2823-4434-9797-026dfc046288 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.444439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2080cd92-2823-4434-9797-026dfc046288 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.527283 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4f69ea44-43da-4a87-809a-cb89a40141b8 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:14.528190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4f69ea44-43da-4a87-809a-cb89a40141b8 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:14.534358 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f69ea44-43da-4a87-809a-cb89a40141b8 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.534800 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f69ea44-43da-4a87-809a-cb89a40141b8 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.535561 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f69ea44-43da-4a87-809a-cb89a40141b8 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.535993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f69ea44-43da-4a87-809a-cb89a40141b8 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.555505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2080cd92-2823-4434-9797-026dfc046288 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 0.124354 Oct 29 13:34:14.559450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 213/403] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:14 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:14.565793 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4f69ea44-43da-4a87-809a-cb89a40141b8 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042264 Oct 29 13:34:14.566355 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 191/404] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:14 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:14.606129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:14.606814 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] [instance: d0ffcd6c-b28c-4d6e-a492-f97a530a91a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:14.613616 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.614095 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.614849 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:14.615273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:14.629127 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] HTTP exception thrown: Instance d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 could not be found. Oct 29 13:34:14.629688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] Returning 404 to user: Instance d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:34:14.630499 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2acbac65-e8c0-4de5-89cc-0b664eb288b9 tempest-VolumesActionsTest-1426190440 tempest-VolumesActionsTest-1426190440-project] 10.222.0.96 "GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4" status: 404 len: 111 microversion: 2.1 time: 0.028226 Oct 29 13:34:14.631001 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 214/405] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:14 2021] GET /compute/v2.1/servers/d0ffcd6c-b28c-4d6e-a492-f97a530a91a4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:34:15.244346 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ed59bf60-3e48-4b9b-bf1b-25c9ee90627c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:15.245246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ed59bf60-3e48-4b9b-bf1b-25c9ee90627c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:15.251299 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed59bf60-3e48-4b9b-bf1b-25c9ee90627c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.251757 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed59bf60-3e48-4b9b-bf1b-25c9ee90627c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.252496 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed59bf60-3e48-4b9b-bf1b-25c9ee90627c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.252932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed59bf60-3e48-4b9b-bf1b-25c9ee90627c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.367524 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:15.368123 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:15.374094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.374528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.375268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.375689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.386664 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ed59bf60-3e48-4b9b-bf1b-25c9ee90627c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.145802 Oct 29 13:34:15.391111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 192/406] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:15 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:15.495407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:15.502766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-10bb4ffe-b148-438c-ad6d-dc63b71776c8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.138818 Oct 29 13:34:15.503316 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 215/407] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:15 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:15.567592 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1c036c4d-088a-4e82-a449-8dcb9db11896 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:15.568586 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1c036c4d-088a-4e82-a449-8dcb9db11896 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:15.575153 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c036c4d-088a-4e82-a449-8dcb9db11896 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.575602 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c036c4d-088a-4e82-a449-8dcb9db11896 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.576367 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c036c4d-088a-4e82-a449-8dcb9db11896 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.576802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c036c4d-088a-4e82-a449-8dcb9db11896 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.577162 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cbb10696-5c74-41f7-a052-d4ef08d8f984 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:15.578599 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cbb10696-5c74-41f7-a052-d4ef08d8f984 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:15.584281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb10696-5c74-41f7-a052-d4ef08d8f984 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.584714 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb10696-5c74-41f7-a052-d4ef08d8f984 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.585465 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb10696-5c74-41f7-a052-d4ef08d8f984 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:15.585916 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb10696-5c74-41f7-a052-d4ef08d8f984 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:15.614743 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cbb10696-5c74-41f7-a052-d4ef08d8f984 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041197 Oct 29 13:34:15.615284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 216/408] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:15 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:16.398472 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3f2d5bf2-d560-483a-b1fd-0055dff3e14c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:16.399366 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3f2d5bf2-d560-483a-b1fd-0055dff3e14c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:16.405003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2d5bf2-d560-483a-b1fd-0055dff3e14c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:16.405439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2d5bf2-d560-483a-b1fd-0055dff3e14c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:16.406216 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2d5bf2-d560-483a-b1fd-0055dff3e14c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:16.406636 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f2d5bf2-d560-483a-b1fd-0055dff3e14c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:18.598509 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1c036c4d-088a-4e82-a449-8dcb9db11896 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 3.034729 Oct 29 13:34:18.599511 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 193/409] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:15 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 3037 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:18.604509 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:18.605023 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:18.611357 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:18.611801 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:18.612568 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:18.613003 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:18.638589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3f2d5bf2-d560-483a-b1fd-0055dff3e14c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 2.243463 Oct 29 13:34:18.640169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 217/410] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:16 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:18.645867 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-94e9351d-fdf9-40c7-bd95-20e76c63abff tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:18.646851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-94e9351d-fdf9-40c7-bd95-20e76c63abff tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:18.653220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94e9351d-fdf9-40c7-bd95-20e76c63abff tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:18.653605 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94e9351d-fdf9-40c7-bd95-20e76c63abff tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:18.654558 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94e9351d-fdf9-40c7-bd95-20e76c63abff tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:18.655147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94e9351d-fdf9-40c7-bd95-20e76c63abff tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:18.684398 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-94e9351d-fdf9-40c7-bd95-20e76c63abff tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042268 Oct 29 13:34:18.684960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 218/411] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:18 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:18.732121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:18.739121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ccc283cf-ca7f-45f5-b20f-49e42ba6999b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.138551 Oct 29 13:34:18.739674 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 194/412] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:18 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:19.610649 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4cb28e9a-d371-48d0-b6da-09d525305f18 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:19.611573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4cb28e9a-d371-48d0-b6da-09d525305f18 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:19.617352 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cb28e9a-d371-48d0-b6da-09d525305f18 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:19.617811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cb28e9a-d371-48d0-b6da-09d525305f18 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:19.618585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cb28e9a-d371-48d0-b6da-09d525305f18 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:19.619014 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4cb28e9a-d371-48d0-b6da-09d525305f18 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:19.650808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a50ed5ba-a314-41be-a574-0927cb13f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:19.651703 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a50ed5ba-a314-41be-a574-0927cb13f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:19.658261 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a50ed5ba-a314-41be-a574-0927cb13f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:19.658696 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a50ed5ba-a314-41be-a574-0927cb13f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:19.659448 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a50ed5ba-a314-41be-a574-0927cb13f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:19.659871 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a50ed5ba-a314-41be-a574-0927cb13f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:22.001266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4cb28e9a-d371-48d0-b6da-09d525305f18 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28626 microversion: 2.1 time: 2.394634 Oct 29 13:34:22.005097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 219/413] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:19 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28626 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:22.006876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-80ad4c5a-726a-4f5f-80cd-2dc72542720b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:22.007852 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-80ad4c5a-726a-4f5f-80cd-2dc72542720b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:22.014129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80ad4c5a-726a-4f5f-80cd-2dc72542720b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:22.014572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80ad4c5a-726a-4f5f-80cd-2dc72542720b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:22.015841 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80ad4c5a-726a-4f5f-80cd-2dc72542720b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:22.016268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80ad4c5a-726a-4f5f-80cd-2dc72542720b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:22.027316 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a50ed5ba-a314-41be-a574-0927cb13f730 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 2.379976 Oct 29 13:34:22.029326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 195/414] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:19 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 2381 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:22.033531 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:22.034189 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:22.040235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:22.040680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:22.041453 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:22.041911 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:22.045530 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-80ad4c5a-726a-4f5f-80cd-2dc72542720b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Oct 29 13:34:22.046111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 220/415] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:22 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:22.159221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:22.166307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-eee145e4-eae9-4ce5-b2d3-115a1a2e385f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.137107 Oct 29 13:34:22.166867 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 196/416] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:22 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:23.012360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2b2edfe2-c0a5-477d-b0f7-83577141026d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:23.013262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2b2edfe2-c0a5-477d-b0f7-83577141026d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:23.019379 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b2edfe2-c0a5-477d-b0f7-83577141026d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.019825 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b2edfe2-c0a5-477d-b0f7-83577141026d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.020585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b2edfe2-c0a5-477d-b0f7-83577141026d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.021020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b2edfe2-c0a5-477d-b0f7-83577141026d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.039501 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9a7d664b-9b5e-4b6a-8976-c72c01b9f2f4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:23.040406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9a7d664b-9b5e-4b6a-8976-c72c01b9f2f4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:23.047095 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a7d664b-9b5e-4b6a-8976-c72c01b9f2f4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.047538 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a7d664b-9b5e-4b6a-8976-c72c01b9f2f4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.048300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a7d664b-9b5e-4b6a-8976-c72c01b9f2f4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.048728 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a7d664b-9b5e-4b6a-8976-c72c01b9f2f4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.114485 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2b2edfe2-c0a5-477d-b0f7-83577141026d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 28744 microversion: 2.1 time: 0.105535 Oct 29 13:34:23.115118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 221/417] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:23 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 28744 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:23.119994 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a5b5dee0-b5f8-44e0-a748-b407f2ac5592 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:23.120999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a5b5dee0-b5f8-44e0-a748-b407f2ac5592 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:23.128225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5b5dee0-b5f8-44e0-a748-b407f2ac5592 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.128670 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5b5dee0-b5f8-44e0-a748-b407f2ac5592 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.129431 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5b5dee0-b5f8-44e0-a748-b407f2ac5592 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.129899 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5b5dee0-b5f8-44e0-a748-b407f2ac5592 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.136140 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9a7d664b-9b5e-4b6a-8976-c72c01b9f2f4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.100239 Oct 29 13:34:23.140070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 197/418] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:23 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:23.158558 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a5b5dee0-b5f8-44e0-a748-b407f2ac5592 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042305 Oct 29 13:34:23.159100 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 222/419] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:34:23 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:34:23.183218 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:23.183911 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:23.190260 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.190704 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.191471 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.191896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.315453 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-755395215", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "797a2d64-a318-481c-b064-119a76b4777f"}]}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:23.317072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:23.324642 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-02eac8ac-bd6e-4dbb-8914-21d1b3bf40a4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.145383 Oct 29 13:34:23.325285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 198/420] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:23 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:23.369357 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] validate_networks() for [('797a2d64-a318-481c-b064-119a76b4777f', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:34:23.741968 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:34:23.742642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:34:23.743163 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:34:23.743757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:34:23.744228 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:34:23.754666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.755192 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.756065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:23.756797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:23.773608 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:34:23.777447 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Getting quotas for user b827e16aad5a47d0bfeebfc3da8a94b9 and project 5dbd3236e0cc40379a8e1e72b80f965e. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:34:23.789616 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:34:23.792229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:34:23.840165 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6f8d5d94-4521-4a49-bd0d-f58adfc24958 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528283 Oct 29 13:34:23.841124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 223/421] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:34:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 13:34:23.852541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-962993b3-41ab-41e0-9e5f-7991b874f8b3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:23.853353 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-962993b3-41ab-41e0-9e5f-7991b874f8b3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:23.911616 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-962993b3-41ab-41e0-9e5f-7991b874f8b3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:23.919532 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-962993b3-41ab-41e0-9e5f-7991b874f8b3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1217 microversion: 2.1 time: 0.071046 Oct 29 13:34:23.920890 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 199/422] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:23 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:24.127496 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0c9c5660-30e0-4efb-850b-e71898740234 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:24.129064 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0c9c5660-30e0-4efb-850b-e71898740234 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:24.136869 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0c9c5660-30e0-4efb-850b-e71898740234 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:24.137313 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0c9c5660-30e0-4efb-850b-e71898740234 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:24.138104 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0c9c5660-30e0-4efb-850b-e71898740234 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:24.138737 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0c9c5660-30e0-4efb-850b-e71898740234 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:24.147368 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4ec29029-db86-4d83-b65c-13612fd2e12c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:24.149038 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4ec29029-db86-4d83-b65c-13612fd2e12c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:24.165265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ec29029-db86-4d83-b65c-13612fd2e12c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:24.166206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ec29029-db86-4d83-b65c-13612fd2e12c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:24.167335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ec29029-db86-4d83-b65c-13612fd2e12c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:24.168482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ec29029-db86-4d83-b65c-13612fd2e12c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:26.941868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0c9c5660-30e0-4efb-850b-e71898740234 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 31654 microversion: 2.1 time: 2.818507 Oct 29 13:34:26.948035 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 224/423] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:24 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 31654 bytes in 2826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:26.953585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:26.954541 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:26.961866 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:26.962082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4ec29029-db86-4d83-b65c-13612fd2e12c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 2.818041 Oct 29 13:34:26.966209 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 200/424] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:24 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 2820 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:26.966891 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:26.967881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:26.968925 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:26.969582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:26.969995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:26.980124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:26.980577 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:26.981680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:26.982317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:27.137602 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:27.145830 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-871afac6-981c-4332-a27a-1c40808502f2 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1213 microversion: 2.1 time: 0.181849 Oct 29 13:34:27.151162 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 201/425] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:26 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1213 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:27.187892 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:27.196515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-acc91eb0-8ec7-4db3-96ee-f7946838db88 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.246977 Oct 29 13:34:27.197413 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 225/426] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:26 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:27.957141 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0afc709a-5360-427c-a0e8-e53ffda710d0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:27.958663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0afc709a-5360-427c-a0e8-e53ffda710d0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:27.966548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0afc709a-5360-427c-a0e8-e53ffda710d0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:27.967630 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0afc709a-5360-427c-a0e8-e53ffda710d0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:27.969105 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0afc709a-5360-427c-a0e8-e53ffda710d0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:27.969888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0afc709a-5360-427c-a0e8-e53ffda710d0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:27.974443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d0f1900c-86e2-4523-8c24-e4b08e4eb255 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:27.976079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d0f1900c-86e2-4523-8c24-e4b08e4eb255 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:27.984061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0f1900c-86e2-4523-8c24-e4b08e4eb255 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:27.989672 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0f1900c-86e2-4523-8c24-e4b08e4eb255 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:27.990864 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0f1900c-86e2-4523-8c24-e4b08e4eb255 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:27.992993 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0f1900c-86e2-4523-8c24-e4b08e4eb255 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:31.363172 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0afc709a-5360-427c-a0e8-e53ffda710d0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 33263 microversion: 2.1 time: 3.412221 Oct 29 13:34:31.368978 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 202/427] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:27 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 33263 bytes in 3419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:31.369728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d0f1900c-86e2-4523-8c24-e4b08e4eb255 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 3.398537 Oct 29 13:34:31.373974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 226/428] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:27 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 3401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:31.378763 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:31.380271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:31.381212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:31.381818 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:31.390078 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:31.390888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:31.391898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:31.392707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:31.396858 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:31.398497 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:31.398810 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:31.400041 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:31.607806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:31.619358 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ca1bde03-3d05-401a-b995-88411ebe7268 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.247384 Oct 29 13:34:31.620341 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 227/429] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:31 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:31.659939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:31.667363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e2764042-9038-4fe5-b8e0-581e76bedceb tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.291621 Oct 29 13:34:31.667996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 203/430] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:31 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:32.084509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-eef3f78b-a679-4d3d-b9c8-b1c40bcb0ec7 req-659cdcb9-fb47-4f64-b385-60f98e579b2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae4732b8-5014-4ab9-9b82-92ba1eb00e61", "tag": "38b68ef9-e1ed-44aa-87a3-8eac040f2c58"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:32.086021 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:34:32.086021 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:34:32.093100 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-eef3f78b-a679-4d3d-b9c8-b1c40bcb0ec7 req-659cdcb9-fb47-4f64-b385-60f98e579b2b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.093788 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-eef3f78b-a679-4d3d-b9c8-b1c40bcb0ec7 req-659cdcb9-fb47-4f64-b385-60f98e579b2b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.106534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-eef3f78b-a679-4d3d-b9c8-b1c40bcb0ec7 req-659cdcb9-fb47-4f64-b385-60f98e579b2b service nova] Creating event network-changed:38b68ef9-e1ed-44aa-87a3-8eac040f2c58 for instance ae4732b8-5014-4ab9-9b82-92ba1eb00e61 on hv-cinder-81588 Oct 29 13:34:32.120636 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-eef3f78b-a679-4d3d-b9c8-b1c40bcb0ec7 req-659cdcb9-fb47-4f64-b385-60f98e579b2b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039092 Oct 29 13:34:32.121673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 228/431] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:34:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:32.376455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ab2ea110-002d-4c67-b9ad-73439ae0b8a2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:32.392371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c9149564-ff3b-4e95-abfa-05ae2ee4f178 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:32.394754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ab2ea110-002d-4c67-b9ad-73439ae0b8a2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:32.398404 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c9149564-ff3b-4e95-abfa-05ae2ee4f178 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:32.408975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9149564-ff3b-4e95-abfa-05ae2ee4f178 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.419815 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ab2ea110-002d-4c67-b9ad-73439ae0b8a2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.420655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ab2ea110-002d-4c67-b9ad-73439ae0b8a2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.422309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ab2ea110-002d-4c67-b9ad-73439ae0b8a2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.423025 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9149564-ff3b-4e95-abfa-05ae2ee4f178 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.424179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9149564-ff3b-4e95-abfa-05ae2ee4f178 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.424677 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ab2ea110-002d-4c67-b9ad-73439ae0b8a2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.427738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9149564-ff3b-4e95-abfa-05ae2ee4f178 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.558588 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ab2ea110-002d-4c67-b9ad-73439ae0b8a2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 33509 microversion: 2.1 time: 0.186068 Oct 29 13:34:32.563977 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 204/432] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:32 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 33509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:32.637049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:32.637858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:32.645067 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.645601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.646476 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.647134 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.793712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:32.803428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e9743b47-34d6-4ff2-aece-0be0cb1fa389 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.170371 Oct 29 13:34:32.805025 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 205/433] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:32 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:32.812152 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:32.813686 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:32.822443 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.823682 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.824879 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:32.825454 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:32.864026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c9149564-ff3b-4e95-abfa-05ae2ee4f178 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.482169 Oct 29 13:34:32.868408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 229/434] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:32 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:33.034294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:33.042536 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-74179685-845b-4995-8635-f09ff0c5661d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.235646 Oct 29 13:34:33.043607 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 206/435] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:32 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:33.570884 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a9aca63f-f637-4231-9c01-25ef42228cf3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:33.571884 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a9aca63f-f637-4231-9c01-25ef42228cf3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:33.584189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9aca63f-f637-4231-9c01-25ef42228cf3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:33.585272 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9aca63f-f637-4231-9c01-25ef42228cf3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:33.586608 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9aca63f-f637-4231-9c01-25ef42228cf3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:33.587037 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a9aca63f-f637-4231-9c01-25ef42228cf3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:33.739112 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a9aca63f-f637-4231-9c01-25ef42228cf3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 33745 microversion: 2.1 time: 0.172754 Oct 29 13:34:33.740027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 230/436] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:33 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 33745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:33.820258 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:33.820878 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:33.827106 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:33.831925 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:33.831925 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:33.831925 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:33.877825 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5605b53e-4dcc-4ce6-ad9e-14700cf49587 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:33.878904 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5605b53e-4dcc-4ce6-ad9e-14700cf49587 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:33.885866 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5605b53e-4dcc-4ce6-ad9e-14700cf49587 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:33.886439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5605b53e-4dcc-4ce6-ad9e-14700cf49587 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:33.887322 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5605b53e-4dcc-4ce6-ad9e-14700cf49587 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:33.887902 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5605b53e-4dcc-4ce6-ad9e-14700cf49587 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:33.965442 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:33.973683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-aae00ae9-34de-403c-bdd9-29f9671688fa tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.157188 Oct 29 13:34:33.974560 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 207/437] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:33 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:34.014669 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5605b53e-4dcc-4ce6-ad9e-14700cf49587 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28608 microversion: 2.20 time: 0.141850 Oct 29 13:34:34.015995 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 231/438] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:33 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28608 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:34.059667 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:34.060291 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:34.066932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:34.067498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:34.068307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:34.068741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:34.236152 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:34.244002 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-80f744b8-59bf-4013-98b8-ff581f5633bf tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.188140 Oct 29 13:34:34.250020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 208/439] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:34 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:34.759099 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ab520525-5472-40a4-8e67-effcc2486ab3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:34.761843 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ab520525-5472-40a4-8e67-effcc2486ab3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:34.774318 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab520525-5472-40a4-8e67-effcc2486ab3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:34.775192 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab520525-5472-40a4-8e67-effcc2486ab3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:34.776674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab520525-5472-40a4-8e67-effcc2486ab3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:34.777681 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab520525-5472-40a4-8e67-effcc2486ab3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:34.908851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ab520525-5472-40a4-8e67-effcc2486ab3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 34169 microversion: 2.1 time: 0.158963 Oct 29 13:34:34.909745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 232/440] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:34 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 34169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:34.990377 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:34.991786 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:34.998114 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:34.998872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:34.999653 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.000111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.029174 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-40f43a49-bf6a-47f6-a138-72f7787757a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:35.031848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-40f43a49-bf6a-47f6-a138-72f7787757a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:35.050719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40f43a49-bf6a-47f6-a138-72f7787757a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.051441 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40f43a49-bf6a-47f6-a138-72f7787757a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.052548 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40f43a49-bf6a-47f6-a138-72f7787757a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.052975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-40f43a49-bf6a-47f6-a138-72f7787757a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.142944 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:35.151115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a21fc785-0343-4fd1-8262-45116460c977 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1501 microversion: 2.1 time: 0.164303 Oct 29 13:34:35.152170 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 209/441] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:34 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1501 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:35.167906 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc859f8c-67a1-4042-b7e7-102e6716190e"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:35.169367 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:35.175813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.176266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.177675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.177675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.202100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] HTTP exception thrown: Cannot 'attach_volume' instance e36bbf99-9c28-4d21-b72b-a31707096ce3 while it is in vm_state rescued Oct 29 13:34:35.203249 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Returning 409 to user: Cannot 'attach_volume' instance e36bbf99-9c28-4d21-b72b-a31707096ce3 while it is in vm_state rescued {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:34:35.204072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8ddbee89-cafa-4888-8f17-a9a77a005320 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040265 Oct 29 13:34:35.204659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 210/442] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:34:35 2021] POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 13:34:35.210348 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-40f43a49-bf6a-47f6-a138-72f7787757a6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 28940 microversion: 2.20 time: 0.186068 Oct 29 13:34:35.214302 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 233/443] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:35 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 28940 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:35.214460 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-69709d38-ed5a-4a9a-bd1f-626a790c6f2c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:35.214460 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-69709d38-ed5a-4a9a-bd1f-626a790c6f2c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:35.220523 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69709d38-ed5a-4a9a-bd1f-626a790c6f2c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.221497 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69709d38-ed5a-4a9a-bd1f-626a790c6f2c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.221753 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69709d38-ed5a-4a9a-bd1f-626a790c6f2c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.222217 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69709d38-ed5a-4a9a-bd1f-626a790c6f2c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.246690 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:35.248076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:35.269932 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.270500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.276208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.276665 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.299455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-69709d38-ed5a-4a9a-bd1f-626a790c6f2c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action" status: 202 len: 0 microversion: 2.1 time: 0.089161 Oct 29 13:34:35.302080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 211/444] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:35 2021] POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:35.307214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:35.308025 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:35.315346 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.315892 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.316742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.317251 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.449994 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lazy-loading 'services' on Instance uuid 7faf1bee-b498-4510-a51e-b088632b19ed {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:34:35.531757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c15d117a-702e-4bc5-abe6-73ca07c385ad tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "DELETE /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed/os-volume_attachments/4f0b6833-bf96-47d4-8016-6d83eb9a2ad0" status: 202 len: 0 microversion: 2.1 time: 0.294376 Oct 29 13:34:35.535989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 234/445] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:34:35 2021] DELETE /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed/os-volume_attachments/4f0b6833-bf96-47d4-8016-6d83eb9a2ad0 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:35.541307 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:35.542027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:35.565231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.568832 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.569877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.570470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.759235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:35.763806 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:35.768222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6949fd51-804e-4c13-930a-5f94591f398c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1509 microversion: 2.1 time: 0.234252 Oct 29 13:34:35.769301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 235/446] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:35 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1509 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:35.776655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1eae2a29-c149-4bf0-b264-1073b751834d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.473208 Oct 29 13:34:35.777238 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 212/447] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:35 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:35.923878 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7b1baa6d-bca9-4287-b384-009d04d13dc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:35.925028 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7b1baa6d-bca9-4287-b384-009d04d13dc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:35.931204 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7b1baa6d-bca9-4287-b384-009d04d13dc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.931861 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7b1baa6d-bca9-4287-b384-009d04d13dc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:35.932797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7b1baa6d-bca9-4287-b384-009d04d13dc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:35.933381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7b1baa6d-bca9-4287-b384-009d04d13dc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:36.042707 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7b1baa6d-bca9-4287-b384-009d04d13dc9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 34846 microversion: 2.1 time: 0.125181 Oct 29 13:34:36.043361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 236/448] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:35 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 34846 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:36.227916 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b1e8128e-44b7-4067-8587-d3ec9b4cf2ce tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:36.228860 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b1e8128e-44b7-4067-8587-d3ec9b4cf2ce tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:36.238092 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b1e8128e-44b7-4067-8587-d3ec9b4cf2ce tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:36.238600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b1e8128e-44b7-4067-8587-d3ec9b4cf2ce tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:36.239470 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b1e8128e-44b7-4067-8587-d3ec9b4cf2ce tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:36.240004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b1e8128e-44b7-4067-8587-d3ec9b4cf2ce tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:36.411995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b1e8128e-44b7-4067-8587-d3ec9b4cf2ce tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 29805 microversion: 2.20 time: 0.188217 Oct 29 13:34:36.412762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 213/449] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:36 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 29805 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:36.786203 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:36.786897 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:36.793689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:36.794407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:36.801100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:36.801543 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:36.802345 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:36.802639 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:36.802761 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:36.803078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:36.803848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:36.804275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:36.956721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:36.964983 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9469ce02-917d-4380-9083-d243588153af tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.175071 Oct 29 13:34:36.974555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 214/450] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:36 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:36.974865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:36.986889 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-324bd75c-b853-4c9f-9935-e77128977804 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1509 microversion: 2.1 time: 0.204593 Oct 29 13:34:36.997186 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 237/451] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:36 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:37.055636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5e59382b-f298-4b79-be11-840a867e6bcd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:37.056555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5e59382b-f298-4b79-be11-840a867e6bcd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:37.064003 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e59382b-f298-4b79-be11-840a867e6bcd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.064452 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e59382b-f298-4b79-be11-840a867e6bcd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.065225 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e59382b-f298-4b79-be11-840a867e6bcd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.065656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e59382b-f298-4b79-be11-840a867e6bcd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.164716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5e59382b-f298-4b79-be11-840a867e6bcd tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 35212 microversion: 2.1 time: 0.112690 Oct 29 13:34:37.169556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 215/452] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:37 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 35212 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:37.425316 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-655eaa5d-7794-46ac-93bc-3da3a58c3c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:37.426651 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-655eaa5d-7794-46ac-93bc-3da3a58c3c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:37.433301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-655eaa5d-7794-46ac-93bc-3da3a58c3c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.433946 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-655eaa5d-7794-46ac-93bc-3da3a58c3c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.434733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-655eaa5d-7794-46ac-93bc-3da3a58c3c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.435166 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-655eaa5d-7794-46ac-93bc-3da3a58c3c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.545223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-655eaa5d-7794-46ac-93bc-3da3a58c3c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 30494 microversion: 2.20 time: 0.124312 Oct 29 13:34:37.546786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 238/453] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:37 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 30494 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:37.791290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:37.792290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:37.798469 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.799104 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.799882 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.800310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.825027 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:34:37.899816 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2839d7ae-ecee-40fd-9459-582353b940dc tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "DELETE /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 204 len: 0 microversion: 2.1 time: 0.112884 Oct 29 13:34:37.900607 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 216/454] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:34:37 2021] DELETE /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:34:37.910207 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:37.910947 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:37.917443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.918274 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.919112 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:37.919741 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:37.986477 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:37.987604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:38.000065 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.000065 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.001136 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.002276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.055665 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:38.063647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-95c355c3-186a-4899-b452-eb4a59befd14 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1515 microversion: 2.1 time: 0.158735 Oct 29 13:34:38.079810 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 239/455] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:37 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:38.094655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:38.095542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:38.110065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.110795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.111740 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.112333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.268159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:38.275611 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:38.279440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6cd75367-329d-45a8-8aeb-01a28fe8660d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.300763 Oct 29 13:34:38.280321 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 217/456] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:37 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:38.284975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3dd743dc-5c20-46cf-95b2-1a54dcb5ed5d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1509 microversion: 2.1 time: 0.203172 Oct 29 13:34:38.285707 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 240/457] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:38 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:38.294984 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a143ec5d-7d3b-4e38-8e00-cd0d484b400d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:38.296568 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a143ec5d-7d3b-4e38-8e00-cd0d484b400d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:38.303131 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a143ec5d-7d3b-4e38-8e00-cd0d484b400d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.303680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a143ec5d-7d3b-4e38-8e00-cd0d484b400d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.304527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a143ec5d-7d3b-4e38-8e00-cd0d484b400d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.305108 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a143ec5d-7d3b-4e38-8e00-cd0d484b400d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.417440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a143ec5d-7d3b-4e38-8e00-cd0d484b400d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 35566 microversion: 2.1 time: 0.126091 Oct 29 13:34:38.418217 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 218/458] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:38 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 35566 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:38.557601 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1c590c6b-4326-4a25-bc24-7fa47e13d068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:38.558507 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1c590c6b-4326-4a25-bc24-7fa47e13d068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:38.566169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1c590c6b-4326-4a25-bc24-7fa47e13d068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.566609 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1c590c6b-4326-4a25-bc24-7fa47e13d068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.567378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1c590c6b-4326-4a25-bc24-7fa47e13d068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:38.567811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1c590c6b-4326-4a25-bc24-7fa47e13d068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:38.687528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1c590c6b-4326-4a25-bc24-7fa47e13d068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 31050 microversion: 2.20 time: 0.133420 Oct 29 13:34:38.688489 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 241/459] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:38 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 31050 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:39.081070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:39.082100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:39.088581 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.089231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.090111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.090697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.218689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:39.226270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ff13a64a-6cf1-4456-b80f-8b3939ae119e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1515 microversion: 2.1 time: 0.149533 Oct 29 13:34:39.226825 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 219/460] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:39 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:39.298921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:39.300222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:39.308914 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:39.310508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:39.312463 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.313097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.314102 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.314688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.316996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.317549 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.318576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.319104 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.454062 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:39.460604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:39.471964 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-31f0a2aa-68e0-4706-a961-a621d0a045fe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.178560 Oct 29 13:34:39.472285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-aab9701b-556e-40fd-a135-d433f8c8d92b tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1509 microversion: 2.1 time: 0.167580 Oct 29 13:34:39.481697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 220/461] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:39 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:39.481697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fa9e2e39-e3cf-43de-bd73-8cfc59b67734 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:39.481697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fa9e2e39-e3cf-43de-bd73-8cfc59b67734 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:39.482254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 242/462] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:39 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:39.485547 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9e2e39-e3cf-43de-bd73-8cfc59b67734 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.486046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9e2e39-e3cf-43de-bd73-8cfc59b67734 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.486832 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9e2e39-e3cf-43de-bd73-8cfc59b67734 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.487261 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa9e2e39-e3cf-43de-bd73-8cfc59b67734 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.621551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fa9e2e39-e3cf-43de-bd73-8cfc59b67734 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 35970 microversion: 2.1 time: 0.147189 Oct 29 13:34:39.622609 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 221/463] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:39 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 35970 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:39.703252 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4964ab3b-21c5-4089-8107-0df98a9d5ff2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:39.704254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4964ab3b-21c5-4089-8107-0df98a9d5ff2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:39.710492 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4964ab3b-21c5-4089-8107-0df98a9d5ff2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.710938 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4964ab3b-21c5-4089-8107-0df98a9d5ff2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.711700 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4964ab3b-21c5-4089-8107-0df98a9d5ff2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:39.712131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4964ab3b-21c5-4089-8107-0df98a9d5ff2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:39.845172 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4964ab3b-21c5-4089-8107-0df98a9d5ff2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 31322 microversion: 2.20 time: 0.149801 Oct 29 13:34:39.852054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 243/464] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:39 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 31322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:40.246627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:40.247983 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:40.256355 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.256827 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.257699 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.258169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.396238 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:40.404117 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5bda82bb-a9a8-46da-9754-daa2ca756f2a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1515 microversion: 2.1 time: 0.161518 Oct 29 13:34:40.404807 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 222/465] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:40 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:40.489663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:40.490399 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:40.497048 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.497500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.498179 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:40.498647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.499171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.499483 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:40.505100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.505559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.506573 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.507011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.628550 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:40.633829 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:40.639111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e8088d06-1f72-47f6-8b5e-18ae0381fd4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1515 microversion: 2.1 time: 0.153774 Oct 29 13:34:40.639700 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 244/466] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:40 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:40.641296 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-63b943d8-5fb2-4b2d-a8d3-9a2f7395f9bd tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.146803 Oct 29 13:34:40.642031 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 223/467] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:40 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:40.644360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-beb0ef84-9008-4bc4-a62e-c6f477a24bb3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:40.645256 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-beb0ef84-9008-4bc4-a62e-c6f477a24bb3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:40.658361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beb0ef84-9008-4bc4-a62e-c6f477a24bb3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.658814 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beb0ef84-9008-4bc4-a62e-c6f477a24bb3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.660299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beb0ef84-9008-4bc4-a62e-c6f477a24bb3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.660299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-beb0ef84-9008-4bc4-a62e-c6f477a24bb3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.816320 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-beb0ef84-9008-4bc4-a62e-c6f477a24bb3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 36967 microversion: 2.1 time: 0.175227 Oct 29 13:34:40.817096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 245/468] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:40 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 36967 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:40.856671 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a9f9e7ee-a74f-4942-964e-8009ffabad01 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:40.857260 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a9f9e7ee-a74f-4942-964e-8009ffabad01 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:40.863793 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a9f9e7ee-a74f-4942-964e-8009ffabad01 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.864244 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a9f9e7ee-a74f-4942-964e-8009ffabad01 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:40.865019 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a9f9e7ee-a74f-4942-964e-8009ffabad01 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:40.865451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a9f9e7ee-a74f-4942-964e-8009ffabad01 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.140642 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a9f9e7ee-a74f-4942-964e-8009ffabad01 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 31820 microversion: 2.20 time: 0.287803 Oct 29 13:34:41.141460 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 224/469] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:40 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 31820 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:41.424805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:41.425511 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:41.435761 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-baa34305-0351-4818-ad99-423cd1f0e26b req-86378759-361e-4c0e-a2d2-f325030e2ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4732b8-5014-4ab9-9b82-92ba1eb00e61", "name": "network-vif-plugged", "status": "completed", "tag": "38b68ef9-e1ed-44aa-87a3-8eac040f2c58"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:41.437972 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:34:41.437972 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:34:41.453233 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.453233 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.453497 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.454002 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.460791 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-baa34305-0351-4818-ad99-423cd1f0e26b req-86378759-361e-4c0e-a2d2-f325030e2ce8 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.461252 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-baa34305-0351-4818-ad99-423cd1f0e26b req-86378759-361e-4c0e-a2d2-f325030e2ce8 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.473856 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-baa34305-0351-4818-ad99-423cd1f0e26b req-86378759-361e-4c0e-a2d2-f325030e2ce8 service nova] Creating event network-vif-plugged:38b68ef9-e1ed-44aa-87a3-8eac040f2c58 for instance ae4732b8-5014-4ab9-9b82-92ba1eb00e61 on hv-cinder-81588 Oct 29 13:34:41.478875 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-baa34305-0351-4818-ad99-423cd1f0e26b req-86378759-361e-4c0e-a2d2-f325030e2ce8 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050256 Oct 29 13:34:41.479459 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 225/470] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:34:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:41.641268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:41.658230 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-49738177-971f-486a-9310-587bcebd9c46 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1515 microversion: 2.1 time: 0.239305 Oct 29 13:34:41.659324 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 246/471] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:41 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1515 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:41.674029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:41.675016 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:41.683855 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.684522 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.685577 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.686191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.808266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-97503f16-71c4-4ad7-9cd2-280a164ea1c7 req-96574612-5a7d-45e4-87ab-8723438cf414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7faf1bee-b498-4510-a51e-b088632b19ed", "name": "network-vif-deleted", "tag": "d544eccb-2834-4068-8fd9-568a5b3d26f1"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:41.809736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:34:41.809736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:34:41.816337 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-97503f16-71c4-4ad7-9cd2-280a164ea1c7 req-96574612-5a7d-45e4-87ab-8723438cf414 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.816775 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-97503f16-71c4-4ad7-9cd2-280a164ea1c7 req-96574612-5a7d-45e4-87ab-8723438cf414 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.828338 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-97503f16-71c4-4ad7-9cd2-280a164ea1c7 req-96574612-5a7d-45e4-87ab-8723438cf414 service nova] Creating event network-vif-deleted:d544eccb-2834-4068-8fd9-568a5b3d26f1 for instance 7faf1bee-b498-4510-a51e-b088632b19ed on hv-cinder-81588 Oct 29 13:34:41.833051 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-97503f16-71c4-4ad7-9cd2-280a164ea1c7 req-96574612-5a7d-45e4-87ab-8723438cf414 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028366 Oct 29 13:34:41.833622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 247/472] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:34:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:41.838393 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ff7f70a9-05dd-45fa-be6b-29001eca2075 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:41.839352 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ff7f70a9-05dd-45fa-be6b-29001eca2075 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:41.845760 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff7f70a9-05dd-45fa-be6b-29001eca2075 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.846235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff7f70a9-05dd-45fa-be6b-29001eca2075 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.846999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff7f70a9-05dd-45fa-be6b-29001eca2075 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.847426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff7f70a9-05dd-45fa-be6b-29001eca2075 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.869300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:41.877370 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5386728f-1744-4ee3-9727-416df48b0e42 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.218570 Oct 29 13:34:41.877949 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 226/473] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:41 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:41.962339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:41.962943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:41.968790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.969231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:41.970082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:41.970747 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.105536 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:42.112710 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-be5b9a61-af41-4960-bcf9-37cc65ba71a3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1515 microversion: 2.1 time: 0.154092 Oct 29 13:34:42.113258 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 227/474] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:41 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:42.127854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ff7f70a9-05dd-45fa-be6b-29001eca2075 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 37580 microversion: 2.1 time: 0.292803 Oct 29 13:34:42.128691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 248/475] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:41 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 37580 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:42.152518 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a312adc8-2f6c-4364-a853-27b2aedde83f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:42.153426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a312adc8-2f6c-4364-a853-27b2aedde83f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:42.159645 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a312adc8-2f6c-4364-a853-27b2aedde83f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.160213 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a312adc8-2f6c-4364-a853-27b2aedde83f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.160997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a312adc8-2f6c-4364-a853-27b2aedde83f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.161349 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a312adc8-2f6c-4364-a853-27b2aedde83f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.171796 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c6610a80-5ea9-4424-9b09-0274d7751c57 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0683a4c0-95bc-4289-977d-61e40f4338ab"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:42.173135 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c6610a80-5ea9-4424-9b09-0274d7751c57 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:42.179736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6610a80-5ea9-4424-9b09-0274d7751c57 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.180182 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6610a80-5ea9-4424-9b09-0274d7751c57 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.180956 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6610a80-5ea9-4424-9b09-0274d7751c57 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.181394 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6610a80-5ea9-4424-9b09-0274d7751c57 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.283822 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a312adc8-2f6c-4364-a853-27b2aedde83f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 32087 microversion: 2.20 time: 0.134867 Oct 29 13:34:42.284689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 228/476] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:42 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 32087 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:42.474190 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c6610a80-5ea9-4424-9b09-0274d7751c57 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308098 Oct 29 13:34:42.475034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 249/477] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:34:42 2021] POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:42.677004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:42.677844 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:42.684516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.684975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.685718 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.686163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.717950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.718319 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.718756 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lazy-loading 'fault' on Instance uuid 7faf1bee-b498-4510-a51e-b088632b19ed {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:34:42.759610 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:42.767797 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-65fdf3b8-e802-4cff-9384-f6eccb22616e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 200 len: 1309 microversion: 2.1 time: 0.094780 Oct 29 13:34:42.768679 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 229/478] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:42 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:42.895135 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:42.896125 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:42.902580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.902960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:42.903772 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:42.904343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:43.139680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-92e9aa6c-287e-452f-9bce-6d91641c83c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:43.140696 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-92e9aa6c-287e-452f-9bce-6d91641c83c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:43.146808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92e9aa6c-287e-452f-9bce-6d91641c83c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:43.147325 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92e9aa6c-287e-452f-9bce-6d91641c83c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:43.148149 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92e9aa6c-287e-452f-9bce-6d91641c83c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:43.148648 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-92e9aa6c-287e-452f-9bce-6d91641c83c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:43.214107 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:43.221844 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d0205ad5-fa84-49ba-8e2a-0d3d2aabb138 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1317 microversion: 2.1 time: 0.330508 Oct 29 13:34:43.222654 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 250/479] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:42 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:43.287618 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-92e9aa6c-287e-452f-9bce-6d91641c83c5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 37922 microversion: 2.1 time: 0.151428 Oct 29 13:34:43.288366 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 230/480] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:43 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 37922 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:43.295423 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0519ae2c-07ef-4f05-b916-81d8b1b89089 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:43.297016 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0519ae2c-07ef-4f05-b916-81d8b1b89089 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:43.302788 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0519ae2c-07ef-4f05-b916-81d8b1b89089 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:43.303231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0519ae2c-07ef-4f05-b916-81d8b1b89089 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:43.304094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0519ae2c-07ef-4f05-b916-81d8b1b89089 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:43.304522 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0519ae2c-07ef-4f05-b916-81d8b1b89089 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:43.407838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0519ae2c-07ef-4f05-b916-81d8b1b89089 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 32483 microversion: 2.20 time: 0.115827 Oct 29 13:34:43.411957 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 251/481] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:43 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 32483 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:43.785807 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:43.786523 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 7faf1bee-b498-4510-a51e-b088632b19ed] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:43.792850 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:43.793304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:43.794107 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:43.794729 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:43.809499 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] HTTP exception thrown: Instance 7faf1bee-b498-4510-a51e-b088632b19ed could not be found. Oct 29 13:34:43.810204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Returning 404 to user: Instance 7faf1bee-b498-4510-a51e-b088632b19ed could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:34:43.811105 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c9867639-404d-4214-9daa-4e97a69478e4 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed" status: 404 len: 111 microversion: 2.1 time: 0.029564 Oct 29 13:34:43.811722 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 231/482] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:43 2021] GET /compute/v2.1/servers/7faf1bee-b498-4510-a51e-b088632b19ed => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:34:44.239415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:44.240097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:44.246634 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:44.247069 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:44.247823 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:44.248493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:44.299651 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b6c03395-a511-41d3-917f-171aad87b53b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:44.300555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b6c03395-a511-41d3-917f-171aad87b53b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:44.306332 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6c03395-a511-41d3-917f-171aad87b53b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:44.306785 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6c03395-a511-41d3-917f-171aad87b53b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:44.307559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6c03395-a511-41d3-917f-171aad87b53b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:44.307994 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b6c03395-a511-41d3-917f-171aad87b53b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:44.371855 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:44.382276 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-37b06997-ece9-47ea-98ef-26a6625c9d22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1506 microversion: 2.1 time: 0.146734 Oct 29 13:34:44.382844 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 252/483] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:44 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:44.419863 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c9f08c64-34d7-4721-8ef2-8f360b67324a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:44.420949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c9f08c64-34d7-4721-8ef2-8f360b67324a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:44.427262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9f08c64-34d7-4721-8ef2-8f360b67324a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:44.427782 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9f08c64-34d7-4721-8ef2-8f360b67324a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:44.429121 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9f08c64-34d7-4721-8ef2-8f360b67324a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:44.429406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9f08c64-34d7-4721-8ef2-8f360b67324a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:47.166691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b6c03395-a511-41d3-917f-171aad87b53b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 200 len: 38206 microversion: 2.1 time: 2.868301 Oct 29 13:34:47.167962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 232/484] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:44 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 38206 bytes in 2873 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:34:47.178681 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-191e8bd7-f2a0-4008-b68b-194713bf275c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:47.179263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-191e8bd7-f2a0-4008-b68b-194713bf275c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:47.185723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-191e8bd7-f2a0-4008-b68b-194713bf275c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:47.186212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-191e8bd7-f2a0-4008-b68b-194713bf275c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:47.186978 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-191e8bd7-f2a0-4008-b68b-194713bf275c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:47.187419 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-191e8bd7-f2a0-4008-b68b-194713bf275c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:47.204235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c9f08c64-34d7-4721-8ef2-8f360b67324a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 34263 microversion: 2.20 time: 2.787718 Oct 29 13:34:47.205413 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 253/485] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:44 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 34263 bytes in 2790 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:47.211811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-191e8bd7-f2a0-4008-b68b-194713bf275c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/ips" status: 200 len: 145 microversion: 2.1 time: 0.037416 Oct 29 13:34:47.212377 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 233/486] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Oct 29 13:34:47 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:34:47.820807 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e0fe3bca-4597-4dde-9f5b-d79daf15773e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d0616c2-b97f-4aba-b599-d491d933512a"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:47.821324 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e0fe3bca-4597-4dde-9f5b-d79daf15773e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:47.827354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0fe3bca-4597-4dde-9f5b-d79daf15773e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:47.827790 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0fe3bca-4597-4dde-9f5b-d79daf15773e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:47.828541 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0fe3bca-4597-4dde-9f5b-d79daf15773e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:47.828965 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e0fe3bca-4597-4dde-9f5b-d79daf15773e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:48.056167 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e0fe3bca-4597-4dde-9f5b-d79daf15773e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "POST /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239869 Oct 29 13:34:48.056765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 254/487] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:34:47 2021] POST /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:48.222896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-22d1d127-b230-4119-9d23-8beb5a532603 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:48.223945 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-22d1d127-b230-4119-9d23-8beb5a532603 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:48.230672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22d1d127-b230-4119-9d23-8beb5a532603 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:48.231179 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22d1d127-b230-4119-9d23-8beb5a532603 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:48.232062 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22d1d127-b230-4119-9d23-8beb5a532603 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:48.232801 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22d1d127-b230-4119-9d23-8beb5a532603 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:48.268780 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1618085335", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:48.318770 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] validate_networks() for None {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:34:48.343849 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-22d1d127-b230-4119-9d23-8beb5a532603 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 34960 microversion: 2.20 time: 0.125242 Oct 29 13:34:48.344996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 234/488] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:48 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 34960 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:48.583552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:34:48.583970 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:34:48.584428 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:34:48.584821 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:34:48.585219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:34:48.593491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:48.594588 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:48.595370 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:48.595794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:48.611430 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Getting quotas for project 4072ee35b45d493ba946a7175bbedb75. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:34:48.615251 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Getting quotas for user 3e5fa4bf7d9b4fd6846c55630d5892fa and project 4072ee35b45d493ba946a7175bbedb75. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:34:48.626567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:34:48.629386 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:34:48.672504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-21b992e4-0b71-4cdb-8149-66c15c587cb0 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.408216 Oct 29 13:34:48.678014 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 255/489] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:34:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 13:34:48.683411 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a0ab238f-8519-47f7-8eba-2034a9095423 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:48.684099 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a0ab238f-8519-47f7-8eba-2034a9095423 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:48.754160 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a0ab238f-8519-47f7-8eba-2034a9095423 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:48.763604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a0ab238f-8519-47f7-8eba-2034a9095423 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1215 microversion: 2.1 time: 0.083936 Oct 29 13:34:48.765073 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 235/490] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:48 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:49.360246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8132d47c-36d5-4946-852f-2fad7f00bb87 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:49.361980 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8132d47c-36d5-4946-852f-2fad7f00bb87 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:49.369685 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8132d47c-36d5-4946-852f-2fad7f00bb87 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:49.370183 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8132d47c-36d5-4946-852f-2fad7f00bb87 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:49.371171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8132d47c-36d5-4946-852f-2fad7f00bb87 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:49.371825 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8132d47c-36d5-4946-852f-2fad7f00bb87 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:49.525405 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8132d47c-36d5-4946-852f-2fad7f00bb87 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 35610 microversion: 2.20 time: 0.172154 Oct 29 13:34:49.526273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 256/491] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:49 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 35610 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:49.782645 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:49.783162 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:49.790402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:49.790846 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:49.791597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:49.792022 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:49.853104 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:49.860638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fce01965-5d92-45c3-8beb-a43131b90f72 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1267 microversion: 2.1 time: 0.081861 Oct 29 13:34:49.861193 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 236/492] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:49 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:50.005156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f56a8f5f-ccd3-483d-a0a0-1a38ee47340b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e95423c4-9b09-4d9a-967b-971c6ddb7abf"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:50.006377 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f56a8f5f-ccd3-483d-a0a0-1a38ee47340b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:50.012657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f56a8f5f-ccd3-483d-a0a0-1a38ee47340b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.013093 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f56a8f5f-ccd3-483d-a0a0-1a38ee47340b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:50.013871 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f56a8f5f-ccd3-483d-a0a0-1a38ee47340b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.014299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f56a8f5f-ccd3-483d-a0a0-1a38ee47340b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:50.047976 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:50.048965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:50.054716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.055161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:50.055923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.056356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:50.078876 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lazy-loading 'flavor' on Instance uuid e36bbf99-9c28-4d21-b72b-a31707096ce3 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:34:50.201265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9dcf1eb4-27dd-45c0-a1a8-6fba6eed4a39 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action" status: 200 len: 32 microversion: 2.1 time: 0.157375 Oct 29 13:34:50.201889 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 237/493] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:34:50 2021] POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:34:50.210659 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:50.211338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:50.217087 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.217528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:50.218303 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.219295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:50.336019 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:50.343584 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-16774411-f94b-4256-92c2-c037227d06f4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.136574 Oct 29 13:34:50.344754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 238/494] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:50 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:50.536830 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d4382181-eeb2-4a8c-8e66-bd28ee6ca8cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:50.537792 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d4382181-eeb2-4a8c-8e66-bd28ee6ca8cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:50.543451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4382181-eeb2-4a8c-8e66-bd28ee6ca8cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.543888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4382181-eeb2-4a8c-8e66-bd28ee6ca8cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:50.544637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4382181-eeb2-4a8c-8e66-bd28ee6ca8cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:50.545059 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4382181-eeb2-4a8c-8e66-bd28ee6ca8cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:52.830362 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d4382181-eeb2-4a8c-8e66-bd28ee6ca8cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 37710 microversion: 2.20 time: 2.296890 Oct 29 13:34:52.831057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 239/495] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:50 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 37710 bytes in 2298 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:52.835827 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:52.836525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:52.842829 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:52.843276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:52.844127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:52.844582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:52.999376 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f56a8f5f-ccd3-483d-a0a0-1a38ee47340b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.997598 Oct 29 13:34:53.001145 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 257/496] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:34:49 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-volume_attachments => generated 194 bytes in 3001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:53.010504 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:53.015665 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:53.016390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:53.023501 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-17286906-4fb2-4a78-a8a1-232dfd2c73e3 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1273 microversion: 2.1 time: 0.191279 Oct 29 13:34:53.024213 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 240/497] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:52 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:53.042794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:53.043362 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:53.044432 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:53.044868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:53.241255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:53.250220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fd580326-b17b-4594-aff3-f752a7d94342 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.247684 Oct 29 13:34:53.250783 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 258/498] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:53 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:53.647426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-739528443", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "networks": [{"uuid": "641c12dc-e9e2-4861-b839-f7d1974ae0f8"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:53.697713 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] validate_networks() for [('641c12dc-e9e2-4861-b839-f7d1974ae0f8', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:34:53.842448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0f9dc8aa-1af3-4b67-948b-1a13ec7f5c9a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:53.843596 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0f9dc8aa-1af3-4b67-948b-1a13ec7f5c9a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:53.850659 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f9dc8aa-1af3-4b67-948b-1a13ec7f5c9a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:53.851195 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f9dc8aa-1af3-4b67-948b-1a13ec7f5c9a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:53.852042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f9dc8aa-1af3-4b67-948b-1a13ec7f5c9a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:53.852538 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f9dc8aa-1af3-4b67-948b-1a13ec7f5c9a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:53.937148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0f9dc8aa-1af3-4b67-948b-1a13ec7f5c9a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 38133 microversion: 2.20 time: 0.097925 Oct 29 13:34:53.938547 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 259/499] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:53 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 38133 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:34:54.041205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:54.041882 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:54.048211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.048659 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.049424 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.049883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.179367 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:54.186549 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8b6414ea-407c-454c-8ed1-9202d9471a33 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.149357 Oct 29 13:34:54.187103 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 260/500] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:54 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:54.267152 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:54.267753 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:54.273420 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.273899 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.274658 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.275086 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.314347 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:34:54.315331 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:34:54.315821 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:34:54.316226 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:34:54.316824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:34:54.326399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.326982 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.327872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.328403 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.344438 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Getting quotas for project f3eb52fe6377419f9b2d3781809c21c5. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:34:54.348325 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Getting quotas for user d3cf89ee80644cb5828017fccc19186d and project f3eb52fe6377419f9b2d3781809c21c5. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:34:54.360037 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:34:54.362438 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:34:54.419835 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d11fd11e-e321-4256-9b06-573932391e27 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774759 Oct 29 13:34:54.420482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 241/501] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:34:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:34:54.427100 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:54.431432 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6345c0f3-6e2c-4286-989a-ae32b83ad112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:54.432046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6345c0f3-6e2c-4286-989a-ae32b83ad112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:54.436736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-47324572-39f2-4c36-882c-f0caf0ab037d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.173257 Oct 29 13:34:54.438109 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 261/502] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:54 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:54.545971 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6345c0f3-6e2c-4286-989a-ae32b83ad112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:54.558271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6345c0f3-6e2c-4286-989a-ae32b83ad112 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1218 microversion: 2.1 time: 0.131110 Oct 29 13:34:54.558845 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 242/503] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:54 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:54.755518 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-1a332b90-382b-47af-bd8a-2c901fa2dbf6 req-0a82ba67-fb28-40f7-ab1c-b5022936c3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ca8180-da00-4601-ba9e-2801a57d1d95", "tag": "055cabbb-1178-43b8-926e-f834674e5586"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:54.757137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:34:54.757137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:34:54.767248 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-1a332b90-382b-47af-bd8a-2c901fa2dbf6 req-0a82ba67-fb28-40f7-ab1c-b5022936c3b4 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.770324 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-1a332b90-382b-47af-bd8a-2c901fa2dbf6 req-0a82ba67-fb28-40f7-ab1c-b5022936c3b4 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.798895 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-1a332b90-382b-47af-bd8a-2c901fa2dbf6 req-0a82ba67-fb28-40f7-ab1c-b5022936c3b4 service nova] Creating event network-changed:055cabbb-1178-43b8-926e-f834674e5586 for instance 13ca8180-da00-4601-ba9e-2801a57d1d95 on hv-cinder-81588 Oct 29 13:34:54.804125 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-1a332b90-382b-47af-bd8a-2c901fa2dbf6 req-0a82ba67-fb28-40f7-ab1c-b5022936c3b4 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052038 Oct 29 13:34:54.804720 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 262/504] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:34:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:54.949297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-37903e57-dee0-4201-95fd-ed2e261ab6f5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:54.950366 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-37903e57-dee0-4201-95fd-ed2e261ab6f5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:54.956197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37903e57-dee0-4201-95fd-ed2e261ab6f5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.956875 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37903e57-dee0-4201-95fd-ed2e261ab6f5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:54.957928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37903e57-dee0-4201-95fd-ed2e261ab6f5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:54.958516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-37903e57-dee0-4201-95fd-ed2e261ab6f5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.073521 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-37903e57-dee0-4201-95fd-ed2e261ab6f5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 200 len: 38276 microversion: 2.20 time: 0.127725 Oct 29 13:34:55.074203 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 243/505] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:54 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 38276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:34:55.085523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9c3cae85-59cf-46c4-a6f6-b13c1a168dbf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:55.086133 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9c3cae85-59cf-46c4-a6f6-b13c1a168dbf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:55.092837 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c3cae85-59cf-46c4-a6f6-b13c1a168dbf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.093452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c3cae85-59cf-46c4-a6f6-b13c1a168dbf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.095091 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c3cae85-59cf-46c4-a6f6-b13c1a168dbf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.095773 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c3cae85-59cf-46c4-a6f6-b13c1a168dbf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.119424 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9c3cae85-59cf-46c4-a6f6-b13c1a168dbf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/ips" status: 200 len: 152 microversion: 2.20 time: 0.038145 Oct 29 13:34:55.119999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 263/506] 10.222.0.96 () {60 vars in 1288 bytes} [Fri Oct 29 13:34:55 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:34:55.204434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:55.205360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:55.211720 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.212172 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.212939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.213367 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.382247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:55.391482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6a3452d2-f318-4f5d-8429-495594346ef4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.190908 Oct 29 13:34:55.392088 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 244/507] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:55 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:55.455231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:55.455591 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:55.461334 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.461786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.462564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.462989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.577509 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:55.580006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:55.587710 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.588161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.588939 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:55.589564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:55.590179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:55.601076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8a5f8052-3850-4e80-98c2-252e61ee68ae tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.150627 Oct 29 13:34:55.602034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 264/508] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:55 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:55.824631 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:55.832495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f8954cce-22b9-4fb1-8a57-d39e51781da9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1270 microversion: 2.1 time: 0.259160 Oct 29 13:34:55.833057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 245/509] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:55 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1270 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:56.408189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:56.408944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:56.414902 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:56.415354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:56.416116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:56.416543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:56.617539 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:56.618263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:56.625432 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:56.626124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:56.626983 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:56.627411 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:56.640786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:56.649028 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-da1805d4-8276-4db8-bb80-555d237fea40 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.244581 Oct 29 13:34:56.649719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 265/510] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:56 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:56.754007 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:56.762622 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c9a13f66-9a1b-4542-a664-bdd36bf4398f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.148809 Oct 29 13:34:56.763297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 246/511] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:56 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:56.849945 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:56.850553 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:56.856176 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:56.856620 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:56.857384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:56.857835 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.023456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-c1f89a9c-f242-4f51-bbb7-fadef498a4cb req-a006839b-54c8-47c0-82f1-d2a5800a3775 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4c33f0-9b48-4bc8-8718-33b972d9f2e6", "tag": "a0c2206d-cf39-440e-9645-2857b817a96f"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:57.025293 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:34:57.025293 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:34:57.033248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-c1f89a9c-f242-4f51-bbb7-fadef498a4cb req-a006839b-54c8-47c0-82f1-d2a5800a3775 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.033862 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-c1f89a9c-f242-4f51-bbb7-fadef498a4cb req-a006839b-54c8-47c0-82f1-d2a5800a3775 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.045029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-c1f89a9c-f242-4f51-bbb7-fadef498a4cb req-a006839b-54c8-47c0-82f1-d2a5800a3775 service nova] Creating event network-changed:a0c2206d-cf39-440e-9645-2857b817a96f for instance 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 on hv-cinder-81588 Oct 29 13:34:57.050145 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-c1f89a9c-f242-4f51-bbb7-fadef498a4cb req-a006839b-54c8-47c0-82f1-d2a5800a3775 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031593 Oct 29 13:34:57.050736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 247/512] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:34:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:34:57.064776 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:57.072054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-701fdcb8-c278-4a41-9a42-642f93f79c4e tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.225695 Oct 29 13:34:57.072612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 266/513] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:56 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:57.653650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:34:57.654837 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:57.661470 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.661978 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.662754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.663192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.665008 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:57.666152 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:57.672475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.672841 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.673628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.674069 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.686892 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lazy-loading 'flavor' on Instance uuid 27c9284f-a335-4a48-9c8b-5e1572d12240 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:34:57.870529 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:57.880190 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ea21a4f2-6529-4c5c-a72c-4992a4ceb753 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.219234 Oct 29 13:34:57.880843 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 267/514] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:57 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:34:57.891572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:57.892287 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:57.898321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.898855 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.899695 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.900294 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.948676 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e1980532-a58e-4cb8-8ae7-bcb4983ceaad tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 202 len: 0 microversion: 2.20 time: 0.298889 Oct 29 13:34:57.949298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 248/515] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:34:57 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:34:57.958102 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:57.958952 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:57.966435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.967075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:57.968026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:57.968655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:58.073354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:58.081261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9a5e30fc-5a2a-4506-a4c5-372cd47c0aff tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.194576 Oct 29 13:34:58.083397 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 268/516] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:57 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:58.089048 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:58.089935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:58.095766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:58.096213 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:58.096983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:58.097418 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:58.103448 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:58.111663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:58.113245 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:58.114506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e901c32e-72f3-42e1-a014-dcf0c7718051 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.160268 Oct 29 13:34:58.115135 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 249/517] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:34:57 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:34:58.215841 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:58.222917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b82f35af-d09b-4f44-ac58-6afe43511d49 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.137370 Oct 29 13:34:58.223487 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 269/518] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:58 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:58.896715 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:58.897325 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:58.903482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:58.903933 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:58.904694 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:58.905130 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.025167 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:59.032968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-98d5614c-e067-4975-bcaa-01bb8d3b94c2 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.139354 Oct 29 13:34:59.033520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 250/519] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:58 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:59.097711 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:59.098332 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:59.104035 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.104470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.105212 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.105641 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.133704 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:59.134330 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:59.140043 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.140484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.141290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.142299 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.228915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:59.240299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c32c3173-1990-45d0-9863-85fc385b40dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.145895 Oct 29 13:34:59.240803 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 270/520] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:59 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:59.245543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:59.246411 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:59.254289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.254593 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.255353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.255786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.265953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:59.274239 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:59.275740 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:59.276899 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e1c7cb29-9651-4d00-905f-c76b5e6a7a84 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.146862 Oct 29 13:34:59.277446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 251/521] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:34:59 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:34:59.381153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:34:59.388986 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e9f2cc77-ac45-4811-9a3f-d592a794745d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.146830 Oct 29 13:34:59.389660 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 271/522] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:34:59 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:34:59.926242 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:34:59.926820 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:34:59.932448 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.932891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:34:59.933660 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:34:59.934112 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.014706 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lazy-loading 'services' on Instance uuid ae4732b8-5014-4ab9-9b82-92ba1eb00e61 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:00.049615 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:00.050249 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:00.056165 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.056670 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.057448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.057922 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.089843 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-edfb5321-40d4-4721-b903-640700b23d46 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments/9d0616c2-b97f-4aba-b599-d491d933512a" status: 202 len: 0 microversion: 2.1 time: 0.167907 Oct 29 13:35:00.093708 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 252/523] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:34:59 2021] DELETE /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments/9d0616c2-b97f-4aba-b599-d491d933512a => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:35:00.099541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7a89abe3-1a33-4719-a82a-e1bfa49b4d88 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:00.100603 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7a89abe3-1a33-4719-a82a-e1bfa49b4d88 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:00.113200 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a89abe3-1a33-4719-a82a-e1bfa49b4d88 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.113830 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a89abe3-1a33-4719-a82a-e1bfa49b4d88 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.114723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a89abe3-1a33-4719-a82a-e1bfa49b4d88 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.115270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7a89abe3-1a33-4719-a82a-e1bfa49b4d88 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.147826 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7a89abe3-1a33-4719-a82a-e1bfa49b4d88 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052280 Oct 29 13:35:00.148609 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 253/524] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:00 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:00.199521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:00.207393 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-83e5a0cb-28c0-4c69-868c-cda6d08b6b8d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.161999 Oct 29 13:35:00.207942 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 272/525] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:00 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:00.256511 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:00.257113 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:00.262873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.263335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.264072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.264500 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.295567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:00.296118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:00.301979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.302429 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.303222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.303660 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.383905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:00.392283 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-af357ff9-7669-4227-a30b-3499240c2543 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.139345 Oct 29 13:35:00.392843 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 254/526] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:00 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:00.405964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:00.406563 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:00.412700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.413154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.413942 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:00.414375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:00.423885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:00.431752 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:00.433334 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:00.434523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5ec1ad99-bb4a-4616-932c-0a6e9d1eaec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.142684 Oct 29 13:35:00.435078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 273/527] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:00 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:00.531868 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:00.538891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-94cc5bcc-d68d-4c02-8d1b-e4f0b09bccce tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.136416 Oct 29 13:35:00.539445 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 255/528] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:00 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:01.160084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-abf9932b-6af5-432d-b064-cc63363f650a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:01.161032 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-abf9932b-6af5-432d-b064-cc63363f650a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:01.166917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abf9932b-6af5-432d-b064-cc63363f650a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.167358 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abf9932b-6af5-432d-b064-cc63363f650a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.168143 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abf9932b-6af5-432d-b064-cc63363f650a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.168570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abf9932b-6af5-432d-b064-cc63363f650a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.196683 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-abf9932b-6af5-432d-b064-cc63363f650a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040905 Oct 29 13:35:01.197219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 274/529] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:01 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:01.224471 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:01.225085 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:01.230842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.231289 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.232061 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.232493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.352136 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:01.359218 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ff76467d-292d-423b-834d-45a073412627 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.138441 Oct 29 13:35:01.359776 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 256/530] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:01 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:01.408116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:01.408741 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:01.414600 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.414982 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.415739 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.416166 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.452109 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:01.452713 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:01.459177 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.459622 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.460397 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.460828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.554300 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:01.562280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c1a98f6e-d82e-48bb-aa37-9402013f5048 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.157668 Oct 29 13:35:01.562847 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 275/531] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:01 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:01.571954 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:01.574747 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:01.584257 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.584733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.586157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.587857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.594948 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:01.603692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:01.606378 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:01.607679 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-accc46a9-cd34-45f1-a6bb-d64c4c3c3baf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.159220 Oct 29 13:35:01.608373 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 257/532] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:01 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:01.681458 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-3fb58fa7-7562-41eb-965f-3ab2a6b966b7 req-980fc1cc-4bb4-4fc7-94be-a5b95a680041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ca8180-da00-4601-ba9e-2801a57d1d95", "name": "network-vif-plugged", "status": "completed", "tag": "055cabbb-1178-43b8-926e-f834674e5586"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:01.683337 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:01.683337 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:35:01.691519 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-3fb58fa7-7562-41eb-965f-3ab2a6b966b7 req-980fc1cc-4bb4-4fc7-94be-a5b95a680041 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:01.692033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-3fb58fa7-7562-41eb-965f-3ab2a6b966b7 req-980fc1cc-4bb4-4fc7-94be-a5b95a680041 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:01.704665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-3fb58fa7-7562-41eb-965f-3ab2a6b966b7 req-980fc1cc-4bb4-4fc7-94be-a5b95a680041 service nova] Creating event network-vif-plugged:055cabbb-1178-43b8-926e-f834674e5586 for instance 13ca8180-da00-4601-ba9e-2801a57d1d95 on hv-cinder-81588 Oct 29 13:35:01.709531 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-3fb58fa7-7562-41eb-965f-3ab2a6b966b7 req-980fc1cc-4bb4-4fc7-94be-a5b95a680041 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Oct 29 13:35:01.710163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 258/533] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:01.719655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:01.727426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-08ad214b-f004-48f2-9170-2dd5e446b0a2 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.158785 Oct 29 13:35:01.728486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 276/534] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:01 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:02.209091 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-be2d2678-9971-45ba-8979-beef8eb43b9a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:02.210162 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-be2d2678-9971-45ba-8979-beef8eb43b9a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:02.215985 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be2d2678-9971-45ba-8979-beef8eb43b9a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.216432 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be2d2678-9971-45ba-8979-beef8eb43b9a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.217205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be2d2678-9971-45ba-8979-beef8eb43b9a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.217639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-be2d2678-9971-45ba-8979-beef8eb43b9a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.245548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-be2d2678-9971-45ba-8979-beef8eb43b9a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040571 Oct 29 13:35:02.246189 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 259/535] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:02 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:02.375179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:02.376610 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:02.382301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.382746 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.383509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.383940 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.503440 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:02.510507 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e8811a97-7b3e-4a0b-beff-4abc3e244932 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.139276 Oct 29 13:35:02.511096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 277/536] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:02 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:02.579393 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:02.579985 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:02.585707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.586168 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.586913 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.587335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.627151 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:02.627762 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:02.633612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.634081 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.634853 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.635280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.709352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:02.717233 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-08d2ef24-42b5-4e27-87b6-4670674f20cb tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.141423 Oct 29 13:35:02.717884 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 260/537] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:02 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:02.744304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:02.745047 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:02.751774 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.752220 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.752975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:02.753401 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:02.755263 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:02.763810 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:02.765554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:02.766849 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-39832692-15ac-432e-97bb-e4d3f1b0a5e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.144348 Oct 29 13:35:02.767494 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 278/538] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:02 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:02.875791 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:02.883045 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ed180528-b3b9-45d4-8d4c-32f3f3244516 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.142418 Oct 29 13:35:02.883607 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 261/539] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:02 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:03.256793 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1537de06-51cb-46fa-8822-89200d1c4361 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:03.257753 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1537de06-51cb-46fa-8822-89200d1c4361 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:03.263590 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1537de06-51cb-46fa-8822-89200d1c4361 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.264036 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1537de06-51cb-46fa-8822-89200d1c4361 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.264797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1537de06-51cb-46fa-8822-89200d1c4361 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.265229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1537de06-51cb-46fa-8822-89200d1c4361 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.294364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1537de06-51cb-46fa-8822-89200d1c4361 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Oct 29 13:35:03.294894 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 279/540] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:03 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:03.526957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:03.527510 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:03.534341 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.534789 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.535624 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.536057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.655340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:03.662543 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1a02bcfe-844b-4316-8d4b-7247a054539a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1315 microversion: 2.1 time: 0.139259 Oct 29 13:35:03.671729 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 262/541] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:03 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:03.732972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:03.733575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:03.739419 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.739857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.740648 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.741073 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.785249 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:03.785848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:03.791534 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.792009 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.792778 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.793211 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.861234 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:03.869068 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0207db50-841f-4803-9bff-0e4652f2cbe4 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.139688 Oct 29 13:35:03.869627 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 280/542] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:03 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:03.899440 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:03.900046 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:03.905765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.906234 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.907024 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:03.907457 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:03.912998 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:03.920648 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:03.922170 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:03.923366 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7f8b4c22-0380-44ab-bc71-47a29ad51870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.141941 Oct 29 13:35:03.923916 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 263/543] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:03 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:04.217123 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:04.224555 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3faa6863-271b-4ee4-9f98-33bd93ca139f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.328624 Oct 29 13:35:04.225111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 281/544] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:03 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:04.305051 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-96e416b0-c4db-4b24-95cd-354bdafe98ef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:04.306039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-96e416b0-c4db-4b24-95cd-354bdafe98ef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:04.311786 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-96e416b0-c4db-4b24-95cd-354bdafe98ef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.312221 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-96e416b0-c4db-4b24-95cd-354bdafe98ef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.312992 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-96e416b0-c4db-4b24-95cd-354bdafe98ef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.314104 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-96e416b0-c4db-4b24-95cd-354bdafe98ef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.341991 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-96e416b0-c4db-4b24-95cd-354bdafe98ef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040612 Oct 29 13:35:04.342524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 264/545] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:04 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:04.679308 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:04.679944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:04.685671 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.686149 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.686911 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.687342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.802891 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:04.810144 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-922b34c7-8c31-49da-92f0-d016d76c36c4 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1464 microversion: 2.1 time: 0.134399 Oct 29 13:35:04.810704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 282/546] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:04 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1464 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:04.846420 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:04.846918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:04.852672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.853106 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.853894 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.854323 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.877741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:04.886651 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:04.887290 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:04.893472 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.893944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.894697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.895124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.953474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b117176f-5a24-4451-b35e-3c95f5f4d964 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "DELETE /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 204 len: 0 microversion: 2.1 time: 0.111041 Oct 29 13:35:04.954456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 265/547] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:04 2021] DELETE /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:35:04.959592 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:04.960285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:04.966013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.966455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:04.967220 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:04.967641 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.023745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:05.031763 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9c1768c1-731f-4c3e-9c7f-eb169a1a12e8 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.148601 Oct 29 13:35:05.032530 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 283/548] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:04 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:05.036692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:05.037289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:05.043144 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:05.043589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.044392 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:05.044988 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.091811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:05.099896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:05.101373 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:05.102541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7318a05c-aebf-42b9-b093-bedad99f5346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.147074 Oct 29 13:35:05.103086 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 266/549] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:04 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:05.165905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:05.173839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b826e588-f69d-4651-8c59-4c687928bd9b tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1470 microversion: 2.1 time: 0.140321 Oct 29 13:35:05.174406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 284/550] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:05 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1470 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:05.241570 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:05.242148 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:05.247859 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:05.248336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.249356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:05.249808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.357228 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-33c0b3c5-e0ad-47f3-8202-ca3ef7012f73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:05.358252 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-33c0b3c5-e0ad-47f3-8202-ca3ef7012f73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:05.364770 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-33c0b3c5-e0ad-47f3-8202-ca3ef7012f73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:05.365216 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-33c0b3c5-e0ad-47f3-8202-ca3ef7012f73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.366726 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-33c0b3c5-e0ad-47f3-8202-ca3ef7012f73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:05.367171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-33c0b3c5-e0ad-47f3-8202-ca3ef7012f73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.368229 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:05.375655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7ec6337d-7e90-42e4-a7a7-329c58d0ec6d tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.137731 Oct 29 13:35:05.376224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 267/551] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:05 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:05.397378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-33c0b3c5-e0ad-47f3-8202-ca3ef7012f73 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047364 Oct 29 13:35:05.397970 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 285/552] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:05 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:05.543115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-00e1bce6-27bf-41e6-9d55-01a40a26d482 req-451ff3b7-7836-413c-9ed5-e9b02e325b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4c33f0-9b48-4bc8-8718-33b972d9f2e6", "name": "network-vif-plugged", "status": "completed", "tag": "a0c2206d-cf39-440e-9645-2857b817a96f"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:05.544743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:05.544743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:35:05.552014 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-00e1bce6-27bf-41e6-9d55-01a40a26d482 req-451ff3b7-7836-413c-9ed5-e9b02e325b65 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:05.552461 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-00e1bce6-27bf-41e6-9d55-01a40a26d482 req-451ff3b7-7836-413c-9ed5-e9b02e325b65 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:05.563426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-00e1bce6-27bf-41e6-9d55-01a40a26d482 req-451ff3b7-7836-413c-9ed5-e9b02e325b65 service nova] Creating event network-vif-plugged:a0c2206d-cf39-440e-9645-2857b817a96f for instance 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 on hv-cinder-81588 Oct 29 13:35:05.568132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-00e1bce6-27bf-41e6-9d55-01a40a26d482 req-451ff3b7-7836-413c-9ed5-e9b02e325b65 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028768 Oct 29 13:35:05.568711 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 268/553] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:06.048415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:06.048950 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:06.054750 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.055198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.055958 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.056391 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.120780 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:06.121460 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:06.128034 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.128476 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.129236 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.129653 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.175608 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:06.183248 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1e098b1e-24e1-4ef8-9b54-527909a90dd3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.138646 Oct 29 13:35:06.183807 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 286/554] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:06 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:06.191289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:06.192095 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:06.198523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.198960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.199709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.200130 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.250029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:06.258317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:06.259833 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:06.260991 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-82a114d6-bdf1-4080-82fc-9b51d29b97bc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.144287 Oct 29 13:35:06.261537 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 269/555] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:06 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:06.320011 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:06.327116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-efa5ea9b-3029-4bdb-871f-1077c8bca5e1 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1470 microversion: 2.1 time: 0.139713 Oct 29 13:35:06.327673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 287/556] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:06 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1470 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:06.392827 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:06.393426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:06.399171 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.399650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.400402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.400828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.409012 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9ef0cd85-1e0b-4888-b428-a43e07f81642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:06.409977 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9ef0cd85-1e0b-4888-b428-a43e07f81642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:06.415739 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ef0cd85-1e0b-4888-b428-a43e07f81642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.416241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ef0cd85-1e0b-4888-b428-a43e07f81642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.416987 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ef0cd85-1e0b-4888-b428-a43e07f81642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.417411 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9ef0cd85-1e0b-4888-b428-a43e07f81642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.447860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9ef0cd85-1e0b-4888-b428-a43e07f81642 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043077 Oct 29 13:35:06.451992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 288/557] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:06 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:06.529055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:06.537061 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-84eae9aa-bf9b-43eb-a09b-1678d233e968 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.148540 Oct 29 13:35:06.537619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 270/558] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:06 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:06.934246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e3d1cd62-4f41-4e8e-8145-7dde81b96e9e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:06.940391 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e3d1cd62-4f41-4e8e-8145-7dde81b96e9e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:06.940830 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e3d1cd62-4f41-4e8e-8145-7dde81b96e9e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:06.998283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e3d1cd62-4f41-4e8e-8145-7dde81b96e9e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Going to try to stop instance {{(pid=122215) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 29 13:35:07.039628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e3d1cd62-4f41-4e8e-8145-7dde81b96e9e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 202 len: 0 microversion: 2.1 time: 0.108765 Oct 29 13:35:07.040225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 289/559] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:35:06 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:35:07.049227 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:07.049891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:07.055883 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.056460 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.057274 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.057745 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.180816 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:07.191111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-83e1bfe8-ba6e-494a-aec5-2c302c3ca285 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.146631 Oct 29 13:35:07.191938 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 271/560] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:07 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:07.203255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:07.203984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:07.210804 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.211299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.212133 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.212588 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.279057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:07.279819 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:07.286352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.286879 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.287717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.288219 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.335070 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:07.343107 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2d553ca4-4dc9-44d4-8def-36316059e9a1 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.143892 Oct 29 13:35:07.343671 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 290/561] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:07 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:07.348372 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:07.348971 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:07.354636 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.355086 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.355852 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.356283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.410129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:07.418271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:07.419847 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:07.421391 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2ae7e74b-ce2b-4d91-bccc-b93e182974f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.145964 Oct 29 13:35:07.422016 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 272/562] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:07 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:07.459320 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e81c3ce0-c3ac-456e-9c2e-84858bdcfc77 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:07.460321 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e81c3ce0-c3ac-456e-9c2e-84858bdcfc77 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:07.466052 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e81c3ce0-c3ac-456e-9c2e-84858bdcfc77 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.466506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e81c3ce0-c3ac-456e-9c2e-84858bdcfc77 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.467282 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e81c3ce0-c3ac-456e-9c2e-84858bdcfc77 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.467721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e81c3ce0-c3ac-456e-9c2e-84858bdcfc77 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.484399 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:07.492436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5e35cf5c-7679-46a3-af14-308946a8432a tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1470 microversion: 2.1 time: 0.147293 Oct 29 13:35:07.493201 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 291/563] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:07 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:07.500314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e81c3ce0-c3ac-456e-9c2e-84858bdcfc77 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045536 Oct 29 13:35:07.500899 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 273/564] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:07 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:07.554730 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:07.555467 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:07.562115 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.562565 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.563360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:07.563831 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:07.775118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:07.782950 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-80c45e7d-88b4-4d4c-8b62-b0d54406a3b9 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1318 microversion: 2.1 time: 0.231989 Oct 29 13:35:07.783515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 292/565] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:07 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:08.092555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-393007f0-ac3a-417c-83ce-42a1d24fed76 req-01c24bdc-df8c-4bc7-83f6-32da829f803d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ca8180-da00-4601-ba9e-2801a57d1d95", "name": "network-vif-deleted", "tag": "055cabbb-1178-43b8-926e-f834674e5586"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:08.094066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:08.094066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:35:08.101803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-393007f0-ac3a-417c-83ce-42a1d24fed76 req-01c24bdc-df8c-4bc7-83f6-32da829f803d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.102255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-393007f0-ac3a-417c-83ce-42a1d24fed76 req-01c24bdc-df8c-4bc7-83f6-32da829f803d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.113880 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-393007f0-ac3a-417c-83ce-42a1d24fed76 req-01c24bdc-df8c-4bc7-83f6-32da829f803d service nova] Creating event network-vif-deleted:055cabbb-1178-43b8-926e-f834674e5586 for instance 13ca8180-da00-4601-ba9e-2801a57d1d95 on hv-cinder-81588 Oct 29 13:35:08.119457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-393007f0-ac3a-417c-83ce-42a1d24fed76 req-01c24bdc-df8c-4bc7-83f6-32da829f803d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030432 Oct 29 13:35:08.120057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 274/566] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:08.208474 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:08.209218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:08.215917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.216364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.217130 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.217631 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.337575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:08.345332 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b92881d5-a5b6-4570-adfa-6adf4e477453 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.140527 Oct 29 13:35:08.346094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 293/567] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:08 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:08.360008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:08.360786 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:08.366646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.367101 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.367864 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.368298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.442124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:08.442831 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:08.448646 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.449098 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.449879 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.450311 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.489910 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:08.497668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a2125fb8-2f1b-4cd4-b01b-2dd32dce1b7a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.141556 Oct 29 13:35:08.498323 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 275/568] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:08 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:08.509757 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:08.510412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:08.516280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.516729 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.517498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.517964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.548182 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.548549 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.548998 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lazy-loading 'fault' on Instance uuid 13ca8180-da00-4601-ba9e-2801a57d1d95 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:08.570063 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:08.577685 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:08.579326 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:08.580503 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-15b6733f-b321-4ed8-9ee0-fae692bc08e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.142753 Oct 29 13:35:08.581062 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 294/569] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:08 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:08.585839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-67ad50ea-7294-498d-82b5-2955b44980f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:08.586899 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-67ad50ea-7294-498d-82b5-2955b44980f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:08.587858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5fa4bf7d9b4fd6846c55630d5892fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4072ee35b45d493ba946a7175bbedb75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:08.592660 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-67ad50ea-7294-498d-82b5-2955b44980f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.593105 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-67ad50ea-7294-498d-82b5-2955b44980f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.593892 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-67ad50ea-7294-498d-82b5-2955b44980f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.594321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-67ad50ea-7294-498d-82b5-2955b44980f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.595270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-13377e01-6aad-4e76-928b-391d56fb228d tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 200 len: 1305 microversion: 2.1 time: 0.089921 Oct 29 13:35:08.595832 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 276/570] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:08 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:08.622398 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-67ad50ea-7294-498d-82b5-2955b44980f6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039925 Oct 29 13:35:08.622931 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 295/571] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:08 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:35:08.800050 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:08.800583 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:08.806411 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.806861 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.807632 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.808059 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.931311 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:08.938646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-07925d7c-f857-4e3e-9027-6a3030fc2b59 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1507 microversion: 2.1 time: 0.142879 Oct 29 13:35:08.939470 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 277/572] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:08 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1507 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:08.954780 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b41aec07-23f0-4787-b9dc-565ddb628d1c tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d46b9011-219a-448a-a01c-9e2caabd903a", "device": "/dev/sdb"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:08.956301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b41aec07-23f0-4787-b9dc-565ddb628d1c tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:08.961976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b41aec07-23f0-4787-b9dc-565ddb628d1c tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.962413 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b41aec07-23f0-4787-b9dc-565ddb628d1c tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:08.963159 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b41aec07-23f0-4787-b9dc-565ddb628d1c tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:08.963581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b41aec07-23f0-4787-b9dc-565ddb628d1c tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.209189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b41aec07-23f0-4787-b9dc-565ddb628d1c tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "POST /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258104 Oct 29 13:35:09.209826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 296/573] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:35:08 2021] POST /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:09.361574 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:09.362070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:09.367901 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.368347 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.369144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.369578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.486871 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:09.494464 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8a12eaba-5826-400b-8a6d-421929b745ec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.136591 Oct 29 13:35:09.495027 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 278/574] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:09 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:09.515558 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:09.516267 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:09.522688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.523134 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.523891 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.524316 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.598550 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:09.599075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:09.604803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.605420 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.606012 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.606449 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.648806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:09.656884 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1d9c43cc-9acb-42ac-8769-3ee8a0094ce3 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.145384 Oct 29 13:35:09.657480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 297/575] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:09 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:09.661720 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:09.662362 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] [instance: 13ca8180-da00-4601-ba9e-2801a57d1d95] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:09.667873 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.668317 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.669078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.669509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.682613 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] HTTP exception thrown: Instance 13ca8180-da00-4601-ba9e-2801a57d1d95 could not be found. Oct 29 13:35:09.683197 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] Returning 404 to user: Instance 13ca8180-da00-4601-ba9e-2801a57d1d95 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:09.684012 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1841bcdb-f162-481e-bf4d-f49714622909 tempest-VolumesNegativeTest-737906646 tempest-VolumesNegativeTest-737906646-project] 10.222.0.96 "GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95" status: 404 len: 111 microversion: 2.1 time: 0.025609 Oct 29 13:35:09.684714 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 298/576] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:09 2021] GET /compute/v2.1/servers/13ca8180-da00-4601-ba9e-2801a57d1d95 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:09.731759 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:09.740053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:09.742111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:09.743307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b21cf723-daa6-46dd-8db2-de266a7ce86f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.148573 Oct 29 13:35:09.743865 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 279/577] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:09 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:09.825589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:09.826094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:09.832423 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.832857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.833606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.834054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.858170 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:09.933929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d870d04f-90c5-4e37-a7a2-c89c105601a1 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 204 len: 0 microversion: 2.1 time: 0.111782 Oct 29 13:35:09.934502 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 299/578] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:09 2021] DELETE /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:35:09.943878 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:09.944796 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:09.951403 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.951974 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:09.953903 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:09.954532 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:10.079628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:10.087511 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e53047eb-9d4c-426f-bd27-55b05b77f824 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1512 microversion: 2.1 time: 0.147516 Oct 29 13:35:10.087731 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 280/579] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:09 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:10.511857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:10.512550 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:10.518847 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:10.519294 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:10.520058 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:10.520486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:10.646887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:10.654598 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fa782808-f3bc-40e5-8579-5f1504258485 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.146658 Oct 29 13:35:10.655156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 300/580] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:10 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:10.674317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:10.675488 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:10.686424 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:10.686935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:10.687802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:10.688295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:10.763081 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:10.763682 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:10.770449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:10.770955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:10.771785 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:10.772284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:10.817906 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:10.826214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e457d74e-fc04-44a5-9b31-f0e84f7786dc tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.156311 Oct 29 13:35:10.826927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 281/581] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:10 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:10.954277 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:10.962171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:10.963673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:10.964831 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1b6de9d8-c2a0-497c-b529-73292c42a052 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.205523 Oct 29 13:35:10.965381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 301/582] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:10 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:11.103249 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:11.103928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:11.109716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.110248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:11.111522 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.111944 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:11.238556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:11.246299 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3b867b15-9b34-4937-a9c3-b2b63bfb8f5b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1512 microversion: 2.1 time: 0.146624 Oct 29 13:35:11.246868 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 282/583] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:11 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:11.672279 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:11.673342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:11.679185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.679638 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:11.680408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.680839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:11.813477 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:11.823772 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b5a67716-03aa-4643-a9af-cde223d9aed0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.155121 Oct 29 13:35:11.824521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 302/584] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:11 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:11.843949 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:11.845390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:11.852351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.852855 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:11.853976 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.854413 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:11.978907 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:11.982974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:11.983722 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:11.989193 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a98490e0-2380-4d7d-8c43-e7ab4679a12d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1567 microversion: 2.1 time: 0.149153 Oct 29 13:35:11.991157 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 283/585] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:11 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:11.991283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.991283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:11.992111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:11.992549 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:12.122859 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:12.134966 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:12.137100 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:12.137753 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dca50adf-582c-493c-abc8-0326ad7bc36c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.158844 Oct 29 13:35:12.138622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 303/586] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:11 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:12.263691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:12.264192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:12.270310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:12.270751 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:12.271512 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:12.271936 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:12.389901 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:12.398224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-41f4cc9a-b4f1-4197-8b39-d830e57f0eb6 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1512 microversion: 2.1 time: 0.138251 Oct 29 13:35:12.398928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 284/587] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:12 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1512 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:12.840606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:12.841199 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:12.847433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:12.847919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:12.848777 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:12.849266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.007892 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:13.008605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:13.014356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.014801 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.015569 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.016002 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.031126 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:13.039546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a8885bc5-e5c2-4dd4-8d28-ef4e295c8a1e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.202531 Oct 29 13:35:13.040110 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 304/588] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:12 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:13.138357 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:13.147662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6564ed3a-3888-4d8b-8ff1-b10ecc0b8934 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1547 microversion: 2.1 time: 0.143094 Oct 29 13:35:13.147912 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 285/589] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:13 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1547 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:13.158246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:13.159102 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:13.165897 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.166961 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.167877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.168013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:13.168511 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:13.168933 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.189081 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.189540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.190357 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.190795 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.281805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] HTTP exception thrown: Cannot 'detach_volume' instance e36bbf99-9c28-4d21-b72b-a31707096ce3 while it is in vm_state rescued Oct 29 13:35:13.282537 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Returning 409 to user: Cannot 'detach_volume' instance e36bbf99-9c28-4d21-b72b-a31707096ce3 while it is in vm_state rescued {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:13.283471 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-64221549-b62f-4233-bb56-d781c182af29 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "DELETE /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments/0683a4c0-95bc-4289-977d-61e40f4338ab" status: 409 len: 152 microversion: 2.1 time: 0.124265 Oct 29 13:35:13.284320 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 286/590] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:35:13 2021] DELETE /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments/0683a4c0-95bc-4289-977d-61e40f4338ab => generated 152 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 29 13:35:13.292983 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6c0a9a0a-b6fd-4832-9c1f-d8d0456ae24a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:13.294315 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6c0a9a0a-b6fd-4832-9c1f-d8d0456ae24a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:13.301239 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c0a9a0a-b6fd-4832-9c1f-d8d0456ae24a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.301787 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c0a9a0a-b6fd-4832-9c1f-d8d0456ae24a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.302900 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c0a9a0a-b6fd-4832-9c1f-d8d0456ae24a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.303405 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c0a9a0a-b6fd-4832-9c1f-d8d0456ae24a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.349819 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:13.382572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:13.384713 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:13.389507 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8a88a8f5-83e3-48af-a122-9c746c4156bb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.234305 Oct 29 13:35:13.400647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 305/591] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:13 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:13.406332 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6c0a9a0a-b6fd-4832-9c1f-d8d0456ae24a tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action" status: 202 len: 0 microversion: 2.1 time: 0.116700 Oct 29 13:35:13.431238 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 287/592] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:35:13 2021] POST /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:35:13.431756 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:13.432510 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:13.437287 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:13.438069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:13.444818 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.445337 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.448386 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.448817 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.461589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.462974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.464801 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.466691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.556150 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:13.568241 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-dd226cb6-5f1c-4ab0-a040-89a9215eff7b tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 200 len: 1470 microversion: 2.1 time: 0.135752 Oct 29 13:35:13.582366 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 288/593] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:13 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 1470 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:13.590445 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-4a72e4f3-596a-4ab8-9cb9-39a55fd631e4 req-90fec90c-651f-482b-9209-d8877b8d566e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae4732b8-5014-4ab9-9b82-92ba1eb00e61", "name": "network-vif-deleted", "tag": "38b68ef9-e1ed-44aa-87a3-8eac040f2c58"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:13.592024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:13.592024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:35:13.609432 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-4a72e4f3-596a-4ab8-9cb9-39a55fd631e4 req-90fec90c-651f-482b-9209-d8877b8d566e service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:13.609810 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-4a72e4f3-596a-4ab8-9cb9-39a55fd631e4 req-90fec90c-651f-482b-9209-d8877b8d566e service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:13.621686 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-4a72e4f3-596a-4ab8-9cb9-39a55fd631e4 req-90fec90c-651f-482b-9209-d8877b8d566e service nova] Creating event network-vif-deleted:38b68ef9-e1ed-44aa-87a3-8eac040f2c58 for instance ae4732b8-5014-4ab9-9b82-92ba1eb00e61 on hv-cinder-81588 Oct 29 13:35:13.627251 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-4a72e4f3-596a-4ab8-9cb9-39a55fd631e4 req-90fec90c-651f-482b-9209-d8877b8d566e service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041934 Oct 29 13:35:13.628099 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 289/594] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:13.725562 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:13.733802 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3ef651b3-565f-4765-b584-bfa37f42850e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1555 microversion: 2.1 time: 0.309233 Oct 29 13:35:13.743393 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 306/595] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:13 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1555 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:14.060639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:14.067423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:14.078839 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.079591 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.081279 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.081931 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.226996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:14.234612 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-15ee38a1-73b6-4034-a61a-51376030f743 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.180527 Oct 29 13:35:14.235199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 290/596] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:14 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:14.407797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:14.408395 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:14.414014 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.414455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.415206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.415631 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.534406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:14.542008 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:14.543487 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:14.544627 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-500785cf-11a5-479a-a28f-35a5cacbdab1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.140601 Oct 29 13:35:14.545180 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 307/597] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:14 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:14.584634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:14.585222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: ae4732b8-5014-4ab9-9b82-92ba1eb00e61] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:14.590910 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.591351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.592107 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.595856 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.605639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] HTTP exception thrown: Instance ae4732b8-5014-4ab9-9b82-92ba1eb00e61 could not be found. Oct 29 13:35:14.606246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Returning 404 to user: Instance ae4732b8-5014-4ab9-9b82-92ba1eb00e61 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:14.607199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a57af670-17bb-464c-942d-385261763cd3 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61" status: 404 len: 111 microversion: 2.1 time: 0.026147 Oct 29 13:35:14.607699 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 291/598] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:14 2021] GET /compute/v2.1/servers/ae4732b8-5014-4ab9-9b82-92ba1eb00e61 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:14.750779 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:14.751891 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:14.757537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.758031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.758908 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:14.759671 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:14.880471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:14.888083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4d05e617-296f-4e0a-97ab-b9235844942e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1555 microversion: 2.1 time: 0.141317 Oct 29 13:35:14.888637 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 308/599] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:14 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1555 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:15.252412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:15.253024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:15.258869 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.259317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.260107 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.260542 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.378098 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:15.385724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d3582a00-f382-46dc-9c1b-afff29fb15cf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.137239 Oct 29 13:35:15.386320 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 292/600] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:15 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:15.562495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:15.563043 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:15.569281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.569743 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.570513 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.570943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.687632 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:15.695743 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:15.697229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:15.698390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dc3d5aff-25d8-4d69-aae3-45591a98b064 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.139628 Oct 29 13:35:15.698949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 309/601] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:15 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:15.735653 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:15.736142 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:15.741864 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.742308 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.743063 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.743494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.769024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:15.852483 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-113f8b82-d60a-4b44-ba03-bf873cefbd4f tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "DELETE /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 204 len: 0 microversion: 2.1 time: 0.120007 Oct 29 13:35:15.853297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 293/602] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:15 2021] DELETE /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:35:15.862691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:15.863812 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:15.870999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.871577 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.872766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.873406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.905700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:15.906435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:15.912925 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.913382 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:15.914201 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:15.914639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:16.011376 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:16.018989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-383aba99-0869-43fd-92f9-cc6f31f21b36 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1513 microversion: 2.1 time: 0.161462 Oct 29 13:35:16.019733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 310/603] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:15 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:16.046614 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:16.054758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bf23e2b9-0027-4153-910c-17aca0037e4e tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1555 microversion: 2.1 time: 0.153683 Oct 29 13:35:16.055322 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 294/604] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:15 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:16.403205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:16.403805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:16.410074 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:16.410519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:16.411266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:16.411691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:16.533136 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:16.540984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-52959ab9-fac0-4889-8ad7-7cd2f4313e1c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.141380 Oct 29 13:35:16.541649 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 311/605] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:16 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:16.716055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:16.717074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:16.723347 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:16.723790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:16.724705 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:16.725130 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:16.845628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:16.853482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:16.855029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:16.858617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1c940b1f-b988-4cf2-ba74-b7e02430a99f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.146131 Oct 29 13:35:16.859183 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 295/606] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:16 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:17.036378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:17.036906 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:17.043080 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.043526 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.044286 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.044716 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.071084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:17.071688 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:17.077334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.077793 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.078603 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.079692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.162517 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:17.180784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c3790797-3351-42d5-aa69-87aaabd5b968 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1513 microversion: 2.1 time: 0.148662 Oct 29 13:35:17.181356 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 312/607] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:17 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:17.201572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:17.210241 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-67dd8d98-a8a8-474a-a3be-50926f1f93d0 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1561 microversion: 2.1 time: 0.142700 Oct 29 13:35:17.210898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 296/608] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:17 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1561 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:17.281977 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:17.282462 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:17.288124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.288512 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.289271 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.289710 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.370157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lazy-loading 'services' on Instance uuid e36bbf99-9c28-4d21-b72b-a31707096ce3 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:17.433567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7c2b8d0f-3a25-497d-b4b3-b8fe49088091 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "DELETE /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments/0683a4c0-95bc-4289-977d-61e40f4338ab" status: 202 len: 0 microversion: 2.1 time: 0.155125 Oct 29 13:35:17.434182 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 313/609] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:35:17 2021] DELETE /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments/0683a4c0-95bc-4289-977d-61e40f4338ab => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:35:17.443017 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8a7987d9-fa40-46b7-a484-4c6d765df0bf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:17.444138 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8a7987d9-fa40-46b7-a484-4c6d765df0bf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:17.450036 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a7987d9-fa40-46b7-a484-4c6d765df0bf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.450499 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a7987d9-fa40-46b7-a484-4c6d765df0bf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.451250 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a7987d9-fa40-46b7-a484-4c6d765df0bf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.451683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8a7987d9-fa40-46b7-a484-4c6d765df0bf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.479632 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8a7987d9-fa40-46b7-a484-4c6d765df0bf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041084 Oct 29 13:35:17.480175 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 297/610] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:17 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:17.559139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:17.559759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:17.566416 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.566887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.567641 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.568064 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.682756 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:17.690921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-80e51945-5187-4d1f-931d-822950e0725a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.135788 Oct 29 13:35:17.691484 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 314/611] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:17 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:17.877338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:17.877973 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:17.883630 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.884146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:17.884915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:17.885341 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:18.003070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:18.010611 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:18.012115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:18.013259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ccc06a49-9da9-4f00-b2ba-daf6a7d3cf73 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.139814 Oct 29 13:35:18.013826 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 298/612] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:17 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:18.198067 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:18.198681 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:18.205301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:18.205746 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:18.206529 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:18.206962 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:18.327935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:18.335636 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0602d9ad-9f46-4c8e-b5f9-1a0e2cff2d8e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1513 microversion: 2.1 time: 0.141279 Oct 29 13:35:18.336197 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 315/613] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:18 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1513 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:18.490314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d9328f54-d943-4fda-80a1-53bfc0008b46 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:18.491166 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d9328f54-d943-4fda-80a1-53bfc0008b46 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:18.496868 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9328f54-d943-4fda-80a1-53bfc0008b46 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:18.497307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9328f54-d943-4fda-80a1-53bfc0008b46 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:18.498090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9328f54-d943-4fda-80a1-53bfc0008b46 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:18.498777 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9328f54-d943-4fda-80a1-53bfc0008b46 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:18.526892 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d9328f54-d943-4fda-80a1-53bfc0008b46 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040398 Oct 29 13:35:18.527424 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 299/614] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:18 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:18.707516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:18.708138 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:18.713845 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:18.714287 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:18.715045 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:18.715466 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:18.833672 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:18.841206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dbc014f4-92a8-49f6-9cbb-967ab134461c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.137272 Oct 29 13:35:18.841763 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 316/615] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:18 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:19.030968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:19.031575 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:19.037957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.038406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.039168 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.039600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.155936 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:19.164059 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:19.165573 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:19.166754 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-feac20ba-4be2-4911-b7c8-84b230120b14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.139438 Oct 29 13:35:19.167310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 300/616] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:19 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:19.352508 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:19.353109 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:19.358876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.359313 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.360065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.360487 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.476255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:19.483406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3b5cb59b-89c2-41b8-8fec-2ccadb711264 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1513 microversion: 2.1 time: 0.134554 Oct 29 13:35:19.483974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 317/617] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:19 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1513 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:19.537712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-33371389-c32c-4919-8c8b-ba3475a9cd8c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:19.538694 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-33371389-c32c-4919-8c8b-ba3475a9cd8c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:19.544388 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-33371389-c32c-4919-8c8b-ba3475a9cd8c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.544833 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-33371389-c32c-4919-8c8b-ba3475a9cd8c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.545603 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-33371389-c32c-4919-8c8b-ba3475a9cd8c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.546069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-33371389-c32c-4919-8c8b-ba3475a9cd8c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.574410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-33371389-c32c-4919-8c8b-ba3475a9cd8c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040446 Oct 29 13:35:19.574943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 301/618] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:19 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:19.858554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:19.859160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:19.865452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.865933 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.866698 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:19.867129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:19.987941 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:19.995559 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f868b788-2c3e-431d-9837-e36e52083a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.140686 Oct 29 13:35:19.996120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 318/619] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:19 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:20.184525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:20.185118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:20.190779 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:20.191211 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:20.191957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:20.192382 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:20.307624 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:20.316088 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:20.317592 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:20.318762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9a0d4e9e-fe65-4664-83ad-53d92cd55e70 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.137882 Oct 29 13:35:20.319312 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 302/620] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:20 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:20.500361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:20.500960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:20.506534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:20.506973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:20.507729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:20.508156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:20.585413 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8fc9df93-58b3-4b8a-acb5-41f30d8cb7b2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:20.586360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8fc9df93-58b3-4b8a-acb5-41f30d8cb7b2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:20.592121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8fc9df93-58b3-4b8a-acb5-41f30d8cb7b2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:20.592559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8fc9df93-58b3-4b8a-acb5-41f30d8cb7b2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:20.593313 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8fc9df93-58b3-4b8a-acb5-41f30d8cb7b2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:20.593739 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8fc9df93-58b3-4b8a-acb5-41f30d8cb7b2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:20.623188 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8fc9df93-58b3-4b8a-acb5-41f30d8cb7b2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041409 Oct 29 13:35:20.624333 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 303/621] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:20 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:20.627099 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:20.634533 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-adee3abe-c868-4d26-9ba8-d989129131ab tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1513 microversion: 2.1 time: 0.138248 Oct 29 13:35:20.635084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 319/622] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:20 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1513 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:21.013450 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:21.014445 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:21.021311 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.021762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.022795 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.023235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.178403 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:21.188823 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a6d703d9-b4e1-481d-aa6f-8f3a8450828c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.178490 Oct 29 13:35:21.189440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 304/623] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:21 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:21.214206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-409c926a-8e51-4ee8-ae93-84230dde4010 req-8a6d2246-ceca-4921-96c2-2ed37e5f0b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bccbf8d-3727-4704-abe1-27a1f8130529", "name": "network-vif-deleted", "tag": "eeb6e964-ec30-49bc-9a5f-8bfdad363b41"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:21.215754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:21.215754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:35:21.222795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-409c926a-8e51-4ee8-ae93-84230dde4010 req-8a6d2246-ceca-4921-96c2-2ed37e5f0b8c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.223252 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-409c926a-8e51-4ee8-ae93-84230dde4010 req-8a6d2246-ceca-4921-96c2-2ed37e5f0b8c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.233919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-409c926a-8e51-4ee8-ae93-84230dde4010 req-8a6d2246-ceca-4921-96c2-2ed37e5f0b8c service nova] Creating event network-vif-deleted:eeb6e964-ec30-49bc-9a5f-8bfdad363b41 for instance 9bccbf8d-3727-4704-abe1-27a1f8130529 on hv-cinder-81588 Oct 29 13:35:21.239697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-409c926a-8e51-4ee8-ae93-84230dde4010 req-8a6d2246-ceca-4921-96c2-2ed37e5f0b8c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028965 Oct 29 13:35:21.240501 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 320/624] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:21.337028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:21.337642 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:21.343787 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.344238 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.345048 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.345559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.464977 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:21.472603 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:21.474125 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:21.475267 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-99095430-2058-43fe-a453-7a57c3bc0bcd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.142273 Oct 29 13:35:21.475825 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 305/625] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:21 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:21.635289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a1704d35-2100-4e87-978e-9ce79b19f7c2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:21.636228 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a1704d35-2100-4e87-978e-9ce79b19f7c2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:21.642396 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1704d35-2100-4e87-978e-9ce79b19f7c2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.642841 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1704d35-2100-4e87-978e-9ce79b19f7c2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.643604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1704d35-2100-4e87-978e-9ce79b19f7c2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.644031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1704d35-2100-4e87-978e-9ce79b19f7c2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.651127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:21.651755 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:21.657838 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.658272 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.659015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.659437 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.672348 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a1704d35-2100-4e87-978e-9ce79b19f7c2 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041149 Oct 29 13:35:21.673537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 321/626] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:35:21 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:35:21.690308 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:21.690748 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:21.691186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lazy-loading 'fault' on Instance uuid 9bccbf8d-3727-4704-abe1-27a1f8130529 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:21.729471 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:21.737541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-973c4060-2d95-4b32-abd1-2de2fd5f5006 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1308 microversion: 2.1 time: 0.089977 Oct 29 13:35:21.740033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 306/627] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:21 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:22.206214 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:22.206811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:22.212510 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:22.212955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:22.213708 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:22.214161 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:22.334583 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:22.342444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-87b89f31-2dd7-42b8-b5a9-fd7b11b54f0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.140324 Oct 29 13:35:22.343038 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 322/628] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:22 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:22.492969 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:22.493499 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:22.499372 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:22.499812 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:22.501071 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:22.501495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:22.615691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:22.623330 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:22.625122 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:22.627297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ef446108-5a41-4b1c-8d42-e4cd8b683b30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.138167 Oct 29 13:35:22.627869 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 307/629] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:22 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:22.755817 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:22.756352 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:22.762803 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:22.763292 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:22.764045 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:22.764465 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:22.793538 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:22.794006 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:22.794448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lazy-loading 'fault' on Instance uuid 9bccbf8d-3727-4704-abe1-27a1f8130529 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:22.836638 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:22.844888 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-21b518af-eb51-4085-bf80-88968fa39162 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1308 microversion: 2.1 time: 0.093936 Oct 29 13:35:22.845449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 323/630] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:22 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1308 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:23.359283 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:23.360643 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:23.366390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:23.366837 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:23.367595 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:23.368024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:23.487332 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:23.495007 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-db90ccb0-2ad7-4308-9eb5-69497488c9f1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.139353 Oct 29 13:35:23.495569 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 308/631] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:23 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:23.645755 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:23.646371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:23.652378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:23.652811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:23.653556 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:23.654001 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:23.770767 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:23.778449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:23.779929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:23.781058 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3344fdf7-29ab-459e-9f4b-7c83d6765e27 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.138952 Oct 29 13:35:23.781612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 324/632] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:23 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:23.861020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:23.861621 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:23.867420 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:23.867858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:23.868609 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:23.869034 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:23.899272 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:23.899716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:23.900159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lazy-loading 'fault' on Instance uuid 9bccbf8d-3727-4704-abe1-27a1f8130529 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:23.937898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:23.945462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-25f38fbb-e84e-4082-abda-d41fe05a2bbe tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 200 len: 1308 microversion: 2.1 time: 0.088104 Oct 29 13:35:23.946067 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 309/633] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:23 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:24.512621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:24.513146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:24.518841 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:24.519283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:24.520044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:24.520468 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:24.647821 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:24.656151 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-aa41c171-8da8-4318-9dce-01628d68a22f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1720 microversion: 2.1 time: 0.147579 Oct 29 13:35:24.657399 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 325/634] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:24 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:24.798970 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:24.799508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:24.805151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:24.805597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:24.806411 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:24.806843 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:24.924219 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:24.932824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:24.934399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:24.935516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0ed81ddc-11c4-4a6e-b482-64e5fc60e4d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.140444 Oct 29 13:35:24.945813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 310/635] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:24 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:24.962204 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:24.962985 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 9bccbf8d-3727-4704-abe1-27a1f8130529] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:24.968547 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:24.969063 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:24.970448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:24.970879 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:24.983789 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] HTTP exception thrown: Instance 9bccbf8d-3727-4704-abe1-27a1f8130529 could not be found. Oct 29 13:35:24.984374 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Returning 404 to user: Instance 9bccbf8d-3727-4704-abe1-27a1f8130529 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:24.985186 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-154f851a-95a5-4408-ae51-b3d35499bb4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529" status: 404 len: 111 microversion: 2.1 time: 0.026758 Oct 29 13:35:24.985969 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 326/636] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:24 2021] GET /compute/v2.1/servers/9bccbf8d-3727-4704-abe1-27a1f8130529 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:24.993711 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:24.994235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:25.000273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.000931 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.001693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.002148 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.027948 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:25.100938 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-eee9888f-3820-42d1-90ea-9474ec6d3e4d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "DELETE /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 204 len: 0 microversion: 2.1 time: 0.110692 Oct 29 13:35:25.101490 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 311/637] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:24 2021] DELETE /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:35:25.109821 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:25.110427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:25.117222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.117882 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.118645 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.119075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.242868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:25.251037 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-30f24514-b5fa-445b-aae7-7d00b7330e4e tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1512 microversion: 2.1 time: 0.145035 Oct 29 13:35:25.251495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 327/638] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:25 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:25.676244 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:25.676942 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:25.682703 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.683154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.683926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.684360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.805640 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:25.813957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f0508fc7-0875-4aa3-9ae0-7bb6adc5da23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1697 microversion: 2.1 time: 0.142185 Oct 29 13:35:25.814517 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 312/639] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:25 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1697 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:25.829949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9a50812d-6df3-4c55-a8fb-38f9480dbfd2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:25.835796 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a50812d-6df3-4c55-a8fb-38f9480dbfd2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.836237 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a50812d-6df3-4c55-a8fb-38f9480dbfd2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.857289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9a50812d-6df3-4c55-a8fb-38f9480dbfd2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Going to try to start instance {{(pid=122215) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 29 13:35:25.895872 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9a50812d-6df3-4c55-a8fb-38f9480dbfd2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 202 len: 0 microversion: 2.1 time: 0.069504 Oct 29 13:35:25.896435 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 328/640] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:35:25 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:35:25.904423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:25.905026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:25.910757 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.911205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.911993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.912409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.955044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:25.955650 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:25.961756 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.962226 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:25.962998 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:25.963423 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:26.037440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:26.045173 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-26241d2a-bf30-4117-a119-7edb1ae71b99 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1706 microversion: 2.1 time: 0.144398 Oct 29 13:35:26.045749 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 313/641] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:25 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1706 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:26.083828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:26.084323 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:26.090130 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:26.090573 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:26.091332 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:26.091831 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:26.116804 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:26.159567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:26.168517 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:26.170698 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:26.172339 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-58125064-4a17-4137-ae6c-9c78f7dad118 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1745 microversion: 2.20 time: 0.221607 Oct 29 13:35:26.193097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 329/642] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:25 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1745 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:26.195943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-94c173c1-5077-4919-884f-e0d56b0c4ae7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "DELETE /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 204 len: 0 microversion: 2.1 time: 0.115403 Oct 29 13:35:26.196541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 314/643] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:26 2021] DELETE /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 13:35:26.204737 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:26.205597 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:26.211433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:26.211881 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:26.212646 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:26.213075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:26.268567 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:26.269261 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:26.275002 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:26.275440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:26.276195 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:26.276623 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:26.405463 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:26.413292 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f991d0da-e797-4ed8-af02-82fcacb2ae22 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1512 microversion: 2.1 time: 0.148798 Oct 29 13:35:26.413890 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 315/644] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:26 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:26.424158 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:26.431472 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5db95fc1-35c3-444d-9878-a443158dd924 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1507 microversion: 2.1 time: 0.230907 Oct 29 13:35:26.432055 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 330/645] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:26 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1507 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:27.063520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:27.064129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:27.070172 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.070622 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.071403 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.071838 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.192525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:27.193067 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:27.202420 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.203233 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.204329 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.204754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.291077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:27.300209 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d083164c-6ed4-409c-acb3-addf9a9ece10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1706 microversion: 2.1 time: 0.240903 Oct 29 13:35:27.301004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 316/646] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:27 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1706 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:27.433943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:27.434564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:27.445193 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:27.454512 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.455014 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.455962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.456391 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.458167 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:27.462650 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:27.464063 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-05507d12-bfa9-4096-9d95-74bc33b06ac1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1745 microversion: 2.20 time: 0.276463 Oct 29 13:35:27.466224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 331/647] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:27 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1745 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:27.476081 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:27.479057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:27.496876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.501229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.502327 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.503895 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.664206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:27.672925 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-00557ab2-179c-4869-b505-16168fbcbc4f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1507 microversion: 2.1 time: 0.204946 Oct 29 13:35:27.673820 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 332/648] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:27 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:27.677607 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:27.685421 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-73405894-ccca-4210-ad78-a20789aeddef tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1512 microversion: 2.1 time: 0.258828 Oct 29 13:35:27.686365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 317/649] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:27 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:27.777077 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-3f949550-7add-43ab-b264-95d45904b00e req-6e213172-22f4-4aad-939c-ffb94d11ec6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2729e752-5a7b-4cc3-9ff3-0647ea7e7770", "name": "network-vif-deleted", "tag": "d39096dc-56c6-4c48-95da-d069d4b1fb81"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:27.779094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:27.779094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:35:27.786814 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-3f949550-7add-43ab-b264-95d45904b00e req-6e213172-22f4-4aad-939c-ffb94d11ec6d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:27.787251 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-3f949550-7add-43ab-b264-95d45904b00e req-6e213172-22f4-4aad-939c-ffb94d11ec6d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:27.798955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-3f949550-7add-43ab-b264-95d45904b00e req-6e213172-22f4-4aad-939c-ffb94d11ec6d service nova] Creating event network-vif-deleted:d39096dc-56c6-4c48-95da-d069d4b1fb81 for instance 2729e752-5a7b-4cc3-9ff3-0647ea7e7770 on hv-cinder-81588 Oct 29 13:35:27.803703 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-3f949550-7add-43ab-b264-95d45904b00e req-6e213172-22f4-4aad-939c-ffb94d11ec6d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030141 Oct 29 13:35:27.804326 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 333/650] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:28.318085 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:28.318719 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:28.324786 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.325233 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.326024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.326457 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.444356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:28.452363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cf8aedef-b237-4118-9e85-26cfcca2d13f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1710 microversion: 2.1 time: 0.137997 Oct 29 13:35:28.452924 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 318/651] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:28 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1710 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:28.485603 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:28.486315 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:28.492592 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.493032 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.493804 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.494258 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.544164 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:28.544656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:28.550975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.551413 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.552192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.552617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.613044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:28.620775 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:28.622302 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:28.623452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f8c656b5-2873-42b5-8adf-3160702fe9fa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1745 microversion: 2.20 time: 0.142800 Oct 29 13:35:28.624268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 334/652] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:28 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1745 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:28.633736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lazy-loading 'services' on Instance uuid 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:28.689264 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:28.689985 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:28.695852 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.697628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.697628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.697858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-080ae934-8d0a-4a5a-b93b-21356310512f tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "DELETE /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6/os-volume_attachments/d46b9011-219a-448a-a01c-9e2caabd903a" status: 202 len: 0 microversion: 2.1 time: 0.157048 Oct 29 13:35:28.697977 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.698513 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 319/653] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:35:28 2021] DELETE /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6/os-volume_attachments/d46b9011-219a-448a-a01c-9e2caabd903a => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:35:28.704041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:28.704742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:28.710889 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.711408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.712279 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.712779 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.744541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:28.745209 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:28.745847 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lazy-loading 'fault' on Instance uuid 2729e752-5a7b-4cc3-9ff3-0647ea7e7770 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:28.794863 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:28.802304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-52bfba07-e308-47e1-93fd-e0ca13ac8658 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 200 len: 1307 microversion: 2.1 time: 0.102553 Oct 29 13:35:28.802872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 320/654] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:28 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:28.878713 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:28.886419 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-87ea02e8-f91f-45f4-9bbf-5a5567bb4236 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1507 microversion: 2.1 time: 0.200848 Oct 29 13:35:28.886992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 335/655] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:28 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:29.642184 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:29.642775 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:29.652855 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:29.653302 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:29.659280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:29.664337 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:29.761568 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-986e2fd1-40e5-4773-9c40-eb1adb2e764f req-d27ab516-517c-49f2-b422-3139cb591d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c9284f-a335-4a48-9c8b-5e1572d12240", "name": "network-vif-plugged", "status": "completed", "tag": "d49765ad-79cc-45ce-898a-88b1395fa0fb"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:29.766868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:29.766868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:35:29.779794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-986e2fd1-40e5-4773-9c40-eb1adb2e764f req-d27ab516-517c-49f2-b422-3139cb591d13 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:29.780693 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-986e2fd1-40e5-4773-9c40-eb1adb2e764f req-d27ab516-517c-49f2-b422-3139cb591d13 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:29.799462 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-986e2fd1-40e5-4773-9c40-eb1adb2e764f req-d27ab516-517c-49f2-b422-3139cb591d13 service nova] Creating event network-vif-plugged:d49765ad-79cc-45ce-898a-88b1395fa0fb for instance 27c9284f-a335-4a48-9c8b-5e1572d12240 on hv-cinder-81588 Oct 29 13:35:29.806628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-986e2fd1-40e5-4773-9c40-eb1adb2e764f req-d27ab516-517c-49f2-b422-3139cb591d13 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047948 Oct 29 13:35:29.807551 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 336/656] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:29.840862 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:29.842855 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: 2729e752-5a7b-4cc3-9ff3-0647ea7e7770] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:29.861684 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:29.864153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:29.865388 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:29.866149 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:29.900561 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] HTTP exception thrown: Instance 2729e752-5a7b-4cc3-9ff3-0647ea7e7770 could not be found. Oct 29 13:35:29.902736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Returning 404 to user: Instance 2729e752-5a7b-4cc3-9ff3-0647ea7e7770 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:29.904541 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-11ae3f7e-57a4-4dfc-966e-962a344b1c98 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770" status: 404 len: 111 microversion: 2.1 time: 0.087942 Oct 29 13:35:29.905860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 337/657] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:29 2021] GET /compute/v2.1/servers/2729e752-5a7b-4cc3-9ff3-0647ea7e7770 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:29.912705 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:29.914738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:29.921318 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:29.923029 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:29.924047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:29.924714 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:30.066689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:30.074719 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:30.078143 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:30.084994 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d4ebe1f8-bf0e-4874-9f47-6154a77a8b75 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.446455 Oct 29 13:35:30.085852 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 321/658] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:29 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:30.098513 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:30.099030 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:30.117186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:30.117890 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:30.118847 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:30.119430 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:30.133967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:30.142894 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2b94c3c5-4d64-453f-ad98-ad99c50fc01d tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 200 len: 1507 microversion: 2.1 time: 0.235213 Oct 29 13:35:30.143824 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 338/659] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:29 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:30.150904 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:30.265187 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e1733f7b-2012-4ae0-a94d-2bd0900eab36 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "DELETE /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 204 len: 0 microversion: 2.1 time: 0.177700 Oct 29 13:35:30.270697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 322/660] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:30 2021] DELETE /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:35:30.283097 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:30.284567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:30.291384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:30.291958 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:30.292848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:30.294089 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:30.442181 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:30.450088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-49afdacc-911c-4d92-999c-da29911b62ae tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1513 microversion: 2.1 time: 0.175395 Oct 29 13:35:30.460312 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 339/661] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:30 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:30.530339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-2b5e5b6a-4ab7-4900-8685-e243e414de54 req-64f783af-18ab-4dd2-b908-00a521c4e15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb48a55c-da01-4b05-845f-ee4e65716b31", "name": "network-vif-deleted", "tag": "4772a4e2-ffbd-436d-be0b-c8b0d53b4648"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:30.533529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:30.533529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:35:30.556582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2b5e5b6a-4ab7-4900-8685-e243e414de54 req-64f783af-18ab-4dd2-b908-00a521c4e15a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:30.559255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2b5e5b6a-4ab7-4900-8685-e243e414de54 req-64f783af-18ab-4dd2-b908-00a521c4e15a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:30.584993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-2b5e5b6a-4ab7-4900-8685-e243e414de54 req-64f783af-18ab-4dd2-b908-00a521c4e15a service nova] Creating event network-vif-deleted:4772a4e2-ffbd-436d-be0b-c8b0d53b4648 for instance eb48a55c-da01-4b05-845f-ee4e65716b31 on hv-cinder-81588 Oct 29 13:35:30.590711 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-2b5e5b6a-4ab7-4900-8685-e243e414de54 req-64f783af-18ab-4dd2-b908-00a521c4e15a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065835 Oct 29 13:35:30.595423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 323/662] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:31.105061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:31.106455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:31.124060 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.128051 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.129226 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.133034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.148876 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:31.150203 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:31.158412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.159062 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.160682 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.161560 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.204175 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:31.270224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:31.284191 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:31.285994 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:31.290972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-636a02d7-d544-47b1-af2c-9301dfbcbf5d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.190017 Oct 29 13:35:31.291541 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 340/663] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:31 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:31.294920 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-706f0f83-f04b-4264-a1f5-c82a24337e4a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "DELETE /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 204 len: 0 microversion: 2.1 time: 0.150067 Oct 29 13:35:31.298982 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:31.299449 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 324/664] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:31 2021] DELETE /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 13:35:31.300232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: eb48a55c-da01-4b05-845f-ee4e65716b31] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:31.307240 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:31.307987 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:31.315004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.315441 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.316209 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.316633 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.322455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.323085 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.324036 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.324460 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.338894 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] HTTP exception thrown: Instance eb48a55c-da01-4b05-845f-ee4e65716b31 could not be found. Oct 29 13:35:31.339882 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Returning 404 to user: Instance eb48a55c-da01-4b05-845f-ee4e65716b31 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:31.340898 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-207cb248-d160-4f0f-afae-57e0b57161ad tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31" status: 404 len: 111 microversion: 2.1 time: 0.048468 Oct 29 13:35:31.341586 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 341/665] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:31 2021] GET /compute/v2.1/servers/eb48a55c-da01-4b05-845f-ee4e65716b31 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:31.349556 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:31.350584 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:31.359696 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.360393 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.361257 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.363015 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.399719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:35:31.459551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:31.468885 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5e62432e-729e-422b-96f2-2f10bd211db0 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1513 microversion: 2.1 time: 0.165442 Oct 29 13:35:31.470461 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 325/666] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:31 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:31.477937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:31.477937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:31.482758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.483475 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.485162 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.485612 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.521991 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fc587e2d-bc8e-42d3-a5a9-82eac3e28e0f tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "DELETE /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 204 len: 0 microversion: 2.1 time: 0.175856 Oct 29 13:35:31.522795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 342/667] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:35:31 2021] DELETE /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 29 13:35:31.535471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:31.536321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:31.546132 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.547406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.548574 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:31.549401 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:31.633477 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:31.642252 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8aca9a89-9abb-41fb-a7ee-7badd582867a tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1513 microversion: 2.1 time: 0.170422 Oct 29 13:35:31.643009 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 326/668] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:31 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:31.706302 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:31.714010 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9401b512-a3b5-4964-81b0-eea28d1dbddf tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.182844 Oct 29 13:35:31.723271 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 343/669] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:31 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:32.308191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:32.309012 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:32.316335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.316784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.317566 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.318103 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.492349 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:32.503371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:32.516921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.517394 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.519929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.520373 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.551688 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:32.559700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:32.561484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:32.562867 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c6059c98-277a-4f7c-a3df-0f5aefd038a7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.258317 Oct 29 13:35:32.575116 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 327/670] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:32 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:32.658557 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:32.659722 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:32.671924 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.673200 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.674555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.675152 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.703454 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:32.713333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ed32429f-0b59-4a12-8bb9-e48e3a2f605a tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1513 microversion: 2.1 time: 0.230597 Oct 29 13:35:32.714424 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 344/671] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:32 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:32.730802 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:32.731406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:32.739397 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.739845 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.740618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:32.741049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:32.894634 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:32.903926 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-65ffdd17-ff87-4d85-ad0c-d68380b4f6b7 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.176809 Oct 29 13:35:32.905861 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 345/672] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:32 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:32.909236 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3cf89ee80644cb5828017fccc19186d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3eb52fe6377419f9b2d3781809c21c5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:32.918481 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-de99020b-93b1-4e7b-a66b-5e555fd95f33 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 200 len: 1513 microversion: 2.1 time: 0.263581 Oct 29 13:35:32.921554 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 328/673] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:32 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:33.087645 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-919c4fa9-ff38-4c91-96b8-5547ab55b1cc req-6df649c8-db06-4532-a591-3b45b7da1023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4c33f0-9b48-4bc8-8718-33b972d9f2e6", "name": "network-vif-deleted", "tag": "a0c2206d-cf39-440e-9645-2857b817a96f"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:33.089219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:33.089219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:35:33.099293 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-919c4fa9-ff38-4c91-96b8-5547ab55b1cc req-6df649c8-db06-4532-a591-3b45b7da1023 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.099963 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-919c4fa9-ff38-4c91-96b8-5547ab55b1cc req-6df649c8-db06-4532-a591-3b45b7da1023 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.126450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-919c4fa9-ff38-4c91-96b8-5547ab55b1cc req-6df649c8-db06-4532-a591-3b45b7da1023 service nova] Creating event network-vif-deleted:a0c2206d-cf39-440e-9645-2857b817a96f for instance 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 on hv-cinder-81588 Oct 29 13:35:33.132456 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-919c4fa9-ff38-4c91-96b8-5547ab55b1cc req-6df649c8-db06-4532-a591-3b45b7da1023 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048397 Oct 29 13:35:33.133868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 346/674] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:33.583220 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:33.583898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:33.595035 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.595478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.596256 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.596683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.732733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:33.734720 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:33.744372 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.745485 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.746968 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.747914 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.855343 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:33.871727 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:33.874731 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:33.876465 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0992cb30-e5ff-4720-9d54-748cd21da270 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.297088 Oct 29 13:35:33.879185 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 329/675] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:33 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:33.921741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:33.923057 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:33.929655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.932952 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.936340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.938550 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.938703 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b827e16aad5a47d0bfeebfc3da8a94b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbd3236e0cc40379a8e1e72b80f965e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:33.948587 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-92d089d7-06ab-4eee-aa5d-d979880eec45 tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 200 len: 1513 microversion: 2.1 time: 0.220595 Oct 29 13:35:33.957905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 347/676] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:33 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:33.957905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:33.957905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] [instance: 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:33.965168 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.967304 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.968407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:33.970272 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:33.986361 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] HTTP exception thrown: Instance 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 could not be found. Oct 29 13:35:33.986966 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] Returning 404 to user: Instance 4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:33.987912 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fdb43951-dd38-4514-87d5-34663a479fa8 tempest-VolumesSnapshotTestJSON-579474674 tempest-VolumesSnapshotTestJSON-579474674-project] 10.222.0.96 "GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6" status: 404 len: 111 microversion: 2.1 time: 0.037381 Oct 29 13:35:33.988552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 348/677] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:33 2021] GET /compute/v2.1/servers/4b4c33f0-9b48-4bc8-8718-33b972d9f2e6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:34.158073 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:34.165722 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cc15d0bc-a1d3-44e0-ab26-8d5e28dc4669 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.247579 Oct 29 13:35:34.175044 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 330/678] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:33 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:34.897411 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:34.898145 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:34.904548 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:34.905328 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:34.906580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:34.907760 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:34.966421 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:34.967681 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] [instance: bd2ea5b2-033b-4585-b78d-30ba7fbd82bd] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:34.977425 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:34.978186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:34.979267 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:34.979865 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:34.994915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] HTTP exception thrown: Instance bd2ea5b2-033b-4585-b78d-30ba7fbd82bd could not be found. Oct 29 13:35:34.995509 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] Returning 404 to user: Instance bd2ea5b2-033b-4585-b78d-30ba7fbd82bd could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:34.996376 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cb7acfc7-cd1c-48a8-9c52-a5748641a73d tempest-AttachVolumeNegativeTest-797183083 tempest-AttachVolumeNegativeTest-797183083-project] 10.222.0.96 "GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd" status: 404 len: 111 microversion: 2.1 time: 0.033604 Oct 29 13:35:34.996933 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 331/679] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:34 2021] GET /compute/v2.1/servers/bd2ea5b2-033b-4585-b78d-30ba7fbd82bd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:35.053452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:35.063623 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:35.065198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:35.066448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-87c69a69-af4b-42d4-9ca5-d526548a5661 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.172699 Oct 29 13:35:35.067474 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 349/680] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:34 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:35.151809 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-959c7bed-93cc-4ece-9f1e-384cddafbc9d req-3545f6ff-a12e-4a55-aa02-ed65f4428cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2ea5b2-033b-4585-b78d-30ba7fbd82bd", "name": "network-vif-deleted", "tag": "becdb76f-bef6-416c-8357-4fa91c08d663"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:35.154089 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:35.154089 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:35:35.163466 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-959c7bed-93cc-4ece-9f1e-384cddafbc9d req-3545f6ff-a12e-4a55-aa02-ed65f4428cfc service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:35.164377 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-959c7bed-93cc-4ece-9f1e-384cddafbc9d req-3545f6ff-a12e-4a55-aa02-ed65f4428cfc service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:35.182495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:35.183443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:35.195483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:35.196193 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:35.197554 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-959c7bed-93cc-4ece-9f1e-384cddafbc9d req-3545f6ff-a12e-4a55-aa02-ed65f4428cfc service nova] Creating event network-vif-deleted:becdb76f-bef6-416c-8357-4fa91c08d663 for instance bd2ea5b2-033b-4585-b78d-30ba7fbd82bd on hv-cinder-81588 Oct 29 13:35:35.201026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:35.201642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:35.209808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-959c7bed-93cc-4ece-9f1e-384cddafbc9d req-3545f6ff-a12e-4a55-aa02-ed65f4428cfc service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063566 Oct 29 13:35:35.210860 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 332/681] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:35:35.398386 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:35.409131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f8ef1d9a-462d-4eb6-a434-6514e822003c tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.230024 Oct 29 13:35:35.428216 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 350/682] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:35 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:36.088279 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:36.090378 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:36.104220 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:36.104567 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:36.106419 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:36.107178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:36.316591 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:36.325848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:36.329318 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:36.331444 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1a941894-fb0c-43e8-8b15-a1457e597378 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.249835 Oct 29 13:35:36.342340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 333/683] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:36 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:36.428263 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:36.429582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:36.441168 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:36.441607 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:36.442404 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:36.442826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:36.591979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:36.602158 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ad10bd4c-ab3d-45cd-ae2e-46bd0de9eb87 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.177377 Oct 29 13:35:36.603171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 351/684] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:36 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:37.349954 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:37.350649 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:37.356488 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:37.357509 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:37.361496 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:37.362639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:37.504283 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:37.521458 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:37.526135 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:37.528548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7be5e16c-f3df-4fe4-8153-4a6f049d102c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.182316 Oct 29 13:35:37.529110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 334/685] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:37 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:37.620166 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:37.621481 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:37.628582 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:37.629623 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:37.630275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:37.630823 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:37.805863 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:37.814423 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-639487ad-279c-44c6-9e19-77c114a93c14 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.198289 Oct 29 13:35:37.825069 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 352/686] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:37 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:35:38.547478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:38.548726 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:38.555096 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:38.559131 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:38.560928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:38.561617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:38.694400 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:38.702494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:38.704035 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:38.705335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fdad5328-f85f-4808-8d42-0b3004fdda24 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1740 microversion: 2.20 time: 0.162263 Oct 29 13:35:38.705825 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 335/687] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:38 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:38.831579 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:38.832851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:38.838927 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:38.839367 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:38.840135 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:38.840564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:38.964807 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:38.973598 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-021dbc28-9a9a-44a2-8ac6-7aeab91ac964 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1521 microversion: 2.1 time: 0.145678 Oct 29 13:35:38.983219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 353/688] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:38 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:39.689459 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-1a92686c-e608-4421-beef-bafbb3c58809 req-ea77db64-99b9-4d04-b7ee-64fb1f583b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36bbf99-9c28-4d21-b72b-a31707096ce3", "name": "network-vif-deleted", "tag": "e4e2d45b-c9a5-4290-bade-10c339385ea2"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:39.691273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:39.691273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:35:39.698324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-1a92686c-e608-4421-beef-bafbb3c58809 req-ea77db64-99b9-4d04-b7ee-64fb1f583b29 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:39.698773 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-1a92686c-e608-4421-beef-bafbb3c58809 req-ea77db64-99b9-4d04-b7ee-64fb1f583b29 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:39.710467 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-1a92686c-e608-4421-beef-bafbb3c58809 req-ea77db64-99b9-4d04-b7ee-64fb1f583b29 service nova] Creating event network-vif-deleted:e4e2d45b-c9a5-4290-bade-10c339385ea2 for instance e36bbf99-9c28-4d21-b72b-a31707096ce3 on hv-cinder-81588 Oct 29 13:35:39.715267 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-1a92686c-e608-4421-beef-bafbb3c58809 req-ea77db64-99b9-4d04-b7ee-64fb1f583b29 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030362 Oct 29 13:35:39.715881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 336/689] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:35:39.722419 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:39.723022 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:39.728786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:39.729223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:39.730104 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:39.730525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:39.870185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:39.880818 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:39.882689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:39.884042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-57e857f0-5fe1-4385-b49a-c4324fff213c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1722 microversion: 2.20 time: 0.165431 Oct 29 13:35:39.884931 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 354/690] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:39 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:39.990697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:39.991403 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:39.997530 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:39.998062 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:39.999288 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:39.999819 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:40.031237 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:40.031827 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:40.032337 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lazy-loading 'fault' on Instance uuid e36bbf99-9c28-4d21-b72b-a31707096ce3 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:35:40.105331 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3dc5d8516c5417dbac44f1bb59467be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7078166fcf074917b62f68cae696746b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:40.117151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ef1f8b16-40eb-4b3d-84c8-77fb4e401214 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 200 len: 1311 microversion: 2.1 time: 0.130155 Oct 29 13:35:40.117932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 337/691] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:39 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:35:40.903120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:40.903720 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:40.909433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:40.909915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:40.910673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:40.911103 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:41.026734 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:41.034401 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:41.035893 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:41.037038 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-eea71fcf-6330-4ec3-a8b8-26cae5e77099 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1722 microversion: 2.20 time: 0.137683 Oct 29 13:35:41.037590 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 355/692] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:40 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1722 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:41.135189 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:41.135824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] [instance: e36bbf99-9c28-4d21-b72b-a31707096ce3] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:41.141854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:41.142307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:41.143069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:41.143508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:41.156893 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] HTTP exception thrown: Instance e36bbf99-9c28-4d21-b72b-a31707096ce3 could not be found. Oct 29 13:35:41.157674 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] Returning 404 to user: Instance e36bbf99-9c28-4d21-b72b-a31707096ce3 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:35:41.158859 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6a568cf5-2c2d-460a-abe5-edb3824cfa13 tempest-ServerRescueNegativeTestJSON-1798079182 tempest-ServerRescueNegativeTestJSON-1798079182-project] 10.222.0.96 "GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3" status: 404 len: 111 microversion: 2.1 time: 0.027388 Oct 29 13:35:41.159600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 338/693] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:35:41 2021] GET /compute/v2.1/servers/e36bbf99-9c28-4d21-b72b-a31707096ce3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:35:42.054848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:42.055418 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:42.061517 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:42.061995 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:42.063297 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:42.063726 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:42.214164 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:42.228018 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:42.238245 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:42.239984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4d85282b-b317-4fdf-aee9-4b4fa5b08802 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1722 microversion: 2.20 time: 0.188832 Oct 29 13:35:42.240567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 356/694] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:42 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:35:43.262076 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:43.263615 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:43.289212 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:43.289909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:43.291285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:43.292046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:43.707456 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-c00eb894-b11c-4e66-91c2-5ec4858924fc req-7aad3343-feee-459b-aff0-796f9a5d2dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c9284f-a335-4a48-9c8b-5e1572d12240", "name": "network-vif-unplugged", "status": "completed", "tag": "d49765ad-79cc-45ce-898a-88b1395fa0fb"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:43.709142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:35:43.709142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:35:43.719549 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-c00eb894-b11c-4e66-91c2-5ec4858924fc req-7aad3343-feee-459b-aff0-796f9a5d2dae service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:43.720064 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-c00eb894-b11c-4e66-91c2-5ec4858924fc req-7aad3343-feee-459b-aff0-796f9a5d2dae service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:43.732809 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.compute.server_external_events [req-c00eb894-b11c-4e66-91c2-5ec4858924fc req-7aad3343-feee-459b-aff0-796f9a5d2dae service nova] Unable to find a host for instance 27c9284f-a335-4a48-9c8b-5e1572d12240. Dropping event network-vif-unplugged {{(pid=122215) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 29 13:35:43.734058 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-c00eb894-b11c-4e66-91c2-5ec4858924fc req-7aad3343-feee-459b-aff0-796f9a5d2dae service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030392 Oct 29 13:35:43.735369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 357/695] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:35:43 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 29 13:35:43.841349 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:43.849230 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:43.851159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:43.852548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5ffac6df-2e14-47bf-bf66-4e34131489b9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1665 microversion: 2.20 time: 0.596422 Oct 29 13:35:43.853176 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 339/696] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:43 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1665 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:43.870422 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-219d9a8b-3e9c-4087-83e9-b930328e71e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a525cf06-a766-4039-a59f-a7473aee12fd"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:43.871632 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-219d9a8b-3e9c-4087-83e9-b930328e71e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:43.878490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-219d9a8b-3e9c-4087-83e9-b930328e71e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:43.878927 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-219d9a8b-3e9c-4087-83e9-b930328e71e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:43.879688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-219d9a8b-3e9c-4087-83e9-b930328e71e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:43.880112 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-219d9a8b-3e9c-4087-83e9-b930328e71e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:44.178348 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-219d9a8b-3e9c-4087-83e9-b930328e71e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.311541 Oct 29 13:35:44.179382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 358/697] 10.222.0.96 () {62 vars in 1363 bytes} [Fri Oct 29 13:35:43 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments => generated 188 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:35:44.306593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-52c19f51-60ed-4746-8579-8be4d9b98d3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:35:44.307117 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-52c19f51-60ed-4746-8579-8be4d9b98d3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:44.313606 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52c19f51-60ed-4746-8579-8be4d9b98d3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:44.314257 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52c19f51-60ed-4746-8579-8be4d9b98d3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:44.315087 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52c19f51-60ed-4746-8579-8be4d9b98d3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:44.315578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-52c19f51-60ed-4746-8579-8be4d9b98d3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:44.445842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-52c19f51-60ed-4746-8579-8be4d9b98d3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action" status: 202 len: 0 microversion: 2.20 time: 0.143009 Oct 29 13:35:44.446741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 340/698] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:35:44 2021] POST /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:35:44.455118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:44.455881 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:44.467301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:44.467954 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:44.469315 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:44.469754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:44.619224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:44.628246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:44.629747 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:44.630926 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-124500da-fee1-45c5-ba11-2aa8623ac28e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1751 microversion: 2.20 time: 0.180026 Oct 29 13:35:44.631489 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 359/699] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:44 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:45.649381 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:45.650039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:45.655634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:45.656113 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:45.656865 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:45.657287 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:45.788918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:45.797582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:45.799101 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:45.800263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e2135421-5180-4134-94ab-d20333dcadeb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1751 microversion: 2.20 time: 0.154563 Oct 29 13:35:45.800808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 341/700] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:45 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:46.818502 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:46.819057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:46.824803 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:46.825250 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:46.826043 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:46.826480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:46.942284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:46.950359 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:46.951848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:46.953506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1a35ddef-a92a-467b-a9f5-d98112b73480 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1751 microversion: 2.20 time: 0.138285 Oct 29 13:35:46.954150 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 360/701] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:46 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1751 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:47.971979 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:47.972557 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:47.978153 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:47.978601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:47.979365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:47.979797 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:48.101601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:48.110661 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:48.112471 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:48.113638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b5ae0a2f-6117-4145-950d-bd1b7a47284d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.146318 Oct 29 13:35:48.114408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 342/702] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:47 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:49.131550 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:49.132155 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:49.137935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:49.138385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:49.139157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:49.139585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:49.301984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:49.310859 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:49.313365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:49.314857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-521b430a-13b2-49ef-ae5d-a04ce433b218 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.186972 Oct 29 13:35:49.315999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 361/703] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:49 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:50.377049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:50.378285 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:50.384689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:50.385147 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:50.385957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:50.386447 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:50.514797 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:50.522993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:50.524527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:50.525675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a85a9034-c3d0-421f-81de-dc0779bb3ee7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.153070 Oct 29 13:35:50.526281 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 343/704] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:50 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:51.545525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:51.546748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:51.553689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:51.554177 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:51.554944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:51.555372 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:51.677220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:51.686012 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:51.688101 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:51.690054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1bf23847-f123-43e9-9491-06b24bf722e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.149412 Oct 29 13:35:51.690607 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 362/705] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:51 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:52.708334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:52.709069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:52.715082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:52.715589 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:52.716456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:52.716886 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:52.913855 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:52.922466 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:52.924589 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:52.925752 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5532eb40-4bf7-42e7-8c19-d8da102473fd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.221760 Oct 29 13:35:52.926334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 344/706] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:52 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:53.944483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:53.945633 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:53.952284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:53.952805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:53.953766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:53.954943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:54.131968 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:54.147028 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:54.151966 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:54.156539 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-81171e3a-2e0f-4139-aab5-86cbf9fdb580 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.216751 Oct 29 13:35:54.162325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 363/707] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:53 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:55.188660 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:55.193362 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:55.200376 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:55.201050 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:55.202054 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:55.202943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:55.368293 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:55.389763 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:55.394753 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:55.396180 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ee66787f-7ef6-44e9-8028-168909402af9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.215949 Oct 29 13:35:55.405858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 345/708] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:55 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:56.417450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:56.418186 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:56.424154 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:56.424618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:56.425472 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:56.425933 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:56.590178 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:56.616882 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:56.618476 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:56.619713 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4aa58eee-7079-4908-8b17-ff5e33413eb3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.206101 Oct 29 13:35:56.620284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 364/709] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:56 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:57.638536 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:57.639891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:57.647423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:57.648026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:57.649049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:57.649579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:57.849782 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:57.875397 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:57.877456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:57.878681 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2b26b227-0afe-41f8-acd7-ec529dad75ac tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.244359 Oct 29 13:35:57.879242 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 346/710] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:57 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:35:58.901719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:35:58.901719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:35:58.905120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:58.905609 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:58.906396 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:35:58.907529 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:35:59.040747 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:59.049933 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:59.051643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:35:59.053172 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f14b874a-d0aa-4389-bc32-952e17629784 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.160157 Oct 29 13:35:59.054278 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 365/711] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:35:58 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:00.070839 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:00.072128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:00.080979 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:00.082013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:00.083163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:00.084042 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:00.290819 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:00.299509 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:00.302346 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:00.303693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2412fcaa-1050-49a1-8485-3dd4db710e91 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.236635 Oct 29 13:36:00.304407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 347/712] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:00 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:36:00.479036 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:36:00.479246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: Fri Oct 29 13:36:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:36:01.322436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:01.323029 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:01.329533 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:01.330010 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:01.330725 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:01.331226 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:01.456644 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:01.468076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:01.470243 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:01.471504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-86847071-7a5f-4c8e-942b-a9ee6f815aab tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.152819 Oct 29 13:36:01.472172 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 366/713] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:01 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:02.492253 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:02.492869 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:02.501660 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:02.502235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:02.503295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:02.503825 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:02.650297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:02.659749 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:02.661247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:02.662453 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-475d28f6-a4f8-4f37-82a7-5b313a770a53 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.176369 Oct 29 13:36:02.663004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 348/714] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:02 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:03.680756 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:03.681406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:03.687854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:03.688983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:03.690029 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:03.690539 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:03.830281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:03.839120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:03.840844 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:03.843382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-90bb647f-f115-4aec-9ce8-09632015548d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.165946 Oct 29 13:36:03.844798 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 367/715] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:03 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:04.862574 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:04.863840 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:04.869940 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:04.870628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:04.871566 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:04.872144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:05.093143 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:05.107979 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:05.113255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:05.119491 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-45650071-c366-4d08-9e78-d731e6403a0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.260582 Oct 29 13:36:05.132890 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 349/716] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:04 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:06.139149 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:06.139813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:06.151513 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:06.151983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:06.152748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:06.155939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:06.570216 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:06.580716 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:06.582298 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:06.583508 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8ba614cb-edb3-4328-be04-e7eda4e85bc6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.448606 Oct 29 13:36:06.584054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 368/717] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:06 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:07.335575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:36:07.336259 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: Fri Oct 29 13:36:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:36:07.608786 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:07.610390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:07.618277 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:07.618963 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:07.620058 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:07.620780 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:07.797168 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:07.807119 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:07.814325 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:07.815831 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1e04c8de-fa6b-4442-af93-26e1c1986cb9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.215899 Oct 29 13:36:07.816915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 350/718] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:07 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:08.834734 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:08.835900 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:08.845118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:08.845843 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:08.847316 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:08.847918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:09.097160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:09.107544 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:09.110218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:09.111886 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-511613b4-26f0-41b1-8fd2-672412072a22 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.280926 Oct 29 13:36:09.124082 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 369/719] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:08 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:10.140351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:10.142751 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:10.150707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:10.151265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:10.152584 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:10.153281 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:10.388161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:10.401321 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:10.403217 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:10.405410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-934142c7-1fd0-4505-bbc8-524748acd983 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.277908 Oct 29 13:36:10.417038 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 351/720] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:10 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:11.199272 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b29d2f2c-95d8-4fc9-967f-da723a5d481e tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Action: 'create', calling method: .version_select at 0x7f547c295b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-36819492"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:11.217029 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-b29d2f2c-95d8-4fc9-967f-da723a5d481e tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for project dda9cf39e3ff4797af5227f990f14457. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:36:11.221560 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-b29d2f2c-95d8-4fc9-967f-da723a5d481e tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for user a1c8d9c5df1a447ea666d48b3a35ec96 and project dda9cf39e3ff4797af5227f990f14457. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:36:11.424874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:11.425548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:11.434629 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:11.435312 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:11.436560 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:11.437267 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:11.470854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-b29d2f2c-95d8-4fc9-967f-da723a5d481e tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for project dda9cf39e3ff4797af5227f990f14457. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:36:11.475137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-b29d2f2c-95d8-4fc9-967f-da723a5d481e tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for user a1c8d9c5df1a447ea666d48b3a35ec96 and project dda9cf39e3ff4797af5227f990f14457. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:36:11.490407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b29d2f2c-95d8-4fc9-967f-da723a5d481e tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.464029 Oct 29 13:36:11.491033 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 370/721] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Oct 29 13:36:11 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:11.586402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:11.610048 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:11.616834 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:11.618619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-35a812fc-ebf3-4f41-828b-56d7c1570c94 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.198140 Oct 29 13:36:11.619190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 352/722] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:11 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:36:11.709650 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:11.710304 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:11.716873 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:11.717402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:11.718283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:11.718981 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:11.881525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lazy-loading 'services' on Instance uuid 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:36:11.981325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d537af69-6ce7-4c82-8718-a4e39af28de1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-volume_attachments/e95423c4-9b09-4d9a-967b-971c6ddb7abf" status: 202 len: 0 microversion: 2.1 time: 0.277298 Oct 29 13:36:11.997465 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 371/723] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:36:11 2021] DELETE /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-volume_attachments/e95423c4-9b09-4d9a-967b-971c6ddb7abf => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:36:12.643859 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:12.645047 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:12.652228 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:12.652847 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:12.654052 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:12.654646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:12.793623 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:12.802590 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:12.804293 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:12.805554 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-99cf752a-3940-454c-9524-5770b7f35260 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.168807 Oct 29 13:36:12.809874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 353/724] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:12 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:13.824918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:13.825607 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:13.832392 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:13.832847 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:13.833590 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:13.834552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:13.976596 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:13.986483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:13.987950 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:13.989095 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3540773a-21ea-4418-811d-d744e623f197 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.168333 Oct 29 13:36:13.989640 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 372/725] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:13 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:15.007680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:15.008282 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:15.013955 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:15.014406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:15.015163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:15.015593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:15.146331 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:15.155084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:15.157235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:15.158600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ff87a769-5d69-49b8-b4cd-4acf1ccf463f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.154660 Oct 29 13:36:15.159191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 354/726] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:15 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:16.177179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:16.178016 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:16.184482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:16.184922 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:16.185701 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:16.186179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:16.364973 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-dd51299d-0bec-4984-8bb1-b42769ad97f8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:16.367979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:16.371448 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd51299d-0bec-4984-8bb1-b42769ad97f8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:16.371968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd51299d-0bec-4984-8bb1-b42769ad97f8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:16.379973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:16.381848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:16.383573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f46f7056-5ad5-4b58-8045-c827486c57b4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.210937 Oct 29 13:36:16.396428 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 373/727] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:16 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:16.447032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-dd51299d-0bec-4984-8bb1-b42769ad97f8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Going to try to stop instance {{(pid=122216) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Oct 29 13:36:16.493309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-dd51299d-0bec-4984-8bb1-b42769ad97f8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 202 len: 0 microversion: 2.1 time: 0.134262 Oct 29 13:36:16.493941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 355/728] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:36:16 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:36:16.502365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:16.503550 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:16.510588 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:16.511026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:16.511795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:16.512219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:16.661044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:16.668277 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-17186db6-8975-409d-8772-018d6357ce71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.169869 Oct 29 13:36:16.668827 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 374/729] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:16 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:16.863704 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-28f9e8ac-5cf9-43f7-aabb-69ab8915153b req-d384cc63-95b0-42a6-9cbd-fbb7c55d6edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c9284f-a335-4a48-9c8b-5e1572d12240", "name": "network-vif-plugged", "status": "completed", "tag": "d49765ad-79cc-45ce-898a-88b1395fa0fb"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:16.865181 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:36:16.865181 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:36:16.872125 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-28f9e8ac-5cf9-43f7-aabb-69ab8915153b req-d384cc63-95b0-42a6-9cbd-fbb7c55d6edf service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:16.872626 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-28f9e8ac-5cf9-43f7-aabb-69ab8915153b req-d384cc63-95b0-42a6-9cbd-fbb7c55d6edf service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:16.886736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-28f9e8ac-5cf9-43f7-aabb-69ab8915153b req-d384cc63-95b0-42a6-9cbd-fbb7c55d6edf service nova] Creating event network-vif-plugged:d49765ad-79cc-45ce-898a-88b1395fa0fb for instance 27c9284f-a335-4a48-9c8b-5e1572d12240 on hv-cinder-81588 Oct 29 13:36:16.892182 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-28f9e8ac-5cf9-43f7-aabb-69ab8915153b req-d384cc63-95b0-42a6-9cbd-fbb7c55d6edf service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032405 Oct 29 13:36:16.892775 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 356/730] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:36:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:36:17.407664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:17.408316 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:17.415359 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:17.416358 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:17.417363 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:17.418267 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:17.555310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:17.564553 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:17.569497 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:17.570780 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-49befeac-8132-4869-84b1-3e2e95b06544 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.168195 Oct 29 13:36:17.571352 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 375/731] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:17 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:36:17.685700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:17.686426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:17.692879 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:17.693337 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:17.694134 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:17.694573 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:17.823507 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:17.831825 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c195ecac-ae4c-421c-b340-35d68c5977ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.150523 Oct 29 13:36:17.832625 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 357/732] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:17 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:18.588606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:18.589343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:18.596180 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:18.596730 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:18.597525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:18.597970 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:18.743179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:18.753227 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:18.754920 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:18.756073 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3066c00d-9d0f-4525-9256-454ebecdaa38 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.171291 Oct 29 13:36:18.756620 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 376/733] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:18 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:18.850620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:18.851226 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:18.857100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:18.857542 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:18.858324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:18.858750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:18.979288 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:18.987385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9a865782-5b8e-4746-8c95-eca75326bacf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.140306 Oct 29 13:36:18.987967 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 358/734] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:18 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:19.776310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:19.776824 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:19.783622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:19.784076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:19.784878 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:19.785314 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:19.910657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:19.918770 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:19.920243 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:19.921374 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f4c7324d-bbb5-46c5-bb9e-b8d0f941266b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.149431 Oct 29 13:36:19.922514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 377/735] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:19 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:20.005082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:20.005690 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:20.011862 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:20.012367 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:20.013315 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:20.013840 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:20.145527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:20.153712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2ec9b8a1-46ff-4bf8-b228-23a9e7914257 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.152536 Oct 29 13:36:20.154337 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 359/736] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:20 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:20.940291 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:20.940897 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:20.946776 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:20.947228 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:20.947989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:20.948419 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:21.071322 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:21.076384 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:21.078019 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:21.079189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d77b5b89-c76d-4b3a-92d4-2aa834984346 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.143241 Oct 29 13:36:21.079744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 378/737] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:20 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:21.171360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:21.172628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:21.178895 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:21.179346 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:21.180124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:21.180565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:21.309102 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:21.316779 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2d7e255a-cf08-49b9-83cb-029ef5c62163 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.149028 Oct 29 13:36:21.317433 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 360/738] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:21 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:22.097220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:22.100889 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:22.106860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:22.107231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:22.108011 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:22.108444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:22.238829 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:22.246885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:22.248595 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:22.250059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9f1a42f6-344a-4820-a25d-9e12a094b29d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.157054 Oct 29 13:36:22.250611 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 379/739] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:22 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:22.334759 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:22.335363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:22.341638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:22.342268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:22.343134 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:22.343571 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:22.466871 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:22.474848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-00072f67-5767-4955-97e6-943da74e2c97 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.143790 Oct 29 13:36:22.475402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 361/740] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:22 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:23.268676 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:23.269328 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:23.275084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:23.275529 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:23.276286 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:23.276718 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:23.398904 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:23.407833 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:23.409330 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:23.410496 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3f3a4893-d092-4589-90f5-f59488599293 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.146096 Oct 29 13:36:23.411039 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 380/741] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:23 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:23.491985 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:23.492628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:23.499353 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:23.499846 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:23.501206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:23.501678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:23.623663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:23.631799 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-beda07c2-5778-422e-9b39-fe499b402a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.143755 Oct 29 13:36:23.632375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 362/742] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:23 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:36:24.428990 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:24.429588 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:24.435466 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:24.435908 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:24.436663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:24.437088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:24.556056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:24.564076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:24.565550 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:24.566739 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b52da7a5-4abb-4932-af39-e422490380ed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.141495 Oct 29 13:36:24.567292 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 381/743] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:24 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:24.649498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:24.650076 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:24.655860 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:24.656334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:24.657645 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:24.658106 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:24.777030 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:24.784700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bb0a18c3-ca1f-4a90-be22-4b84a438924e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.138968 Oct 29 13:36:24.785250 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 363/744] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:24 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:25.584784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:25.585503 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:25.591208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:25.591646 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:25.592403 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:25.592829 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:25.713395 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:25.722280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:25.723775 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:25.724924 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cc0cf608-3f56-41e1-b8bf-2799bbff3043 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.143866 Oct 29 13:36:25.725483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 382/745] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:25 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:25.802355 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:25.803524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:25.809965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:25.810418 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:25.811392 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:25.811878 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:25.936848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:25.944329 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1c788f0a-946f-4f9c-9810-f80a4e6f4793 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.145853 Oct 29 13:36:25.954129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 364/746] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:25 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:26.743816 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:26.744371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:26.751203 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:26.751656 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:26.752514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:26.752907 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:26.892032 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:26.900342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:26.901836 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:26.902989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b4935ab9-e89a-449b-b8f2-b57b172ce54f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.163195 Oct 29 13:36:26.903528 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 383/747] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:26 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:26.961294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:26.961935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:26.967605 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:26.968153 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:26.969591 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:26.970053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:27.095469 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:27.102994 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cd0baf61-3857-4622-a50e-7b059fba5894 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.145232 Oct 29 13:36:27.103631 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 365/748] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:26 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:27.921552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:27.922114 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:27.927887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:27.928326 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:27.929076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:27.929500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:28.055828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:28.064679 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:28.066222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:28.067367 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-59e76fbe-a518-4d4e-9c14-aa9bf07c5d52 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.149540 Oct 29 13:36:28.067916 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 384/749] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:27 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:28.153206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:28.153830 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:28.159922 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:28.160328 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:28.161068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:28.161602 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:28.292038 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:28.299755 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-157b619f-9e51-4d7b-b2fd-4738851467b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.150074 Oct 29 13:36:28.300360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 366/750] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:28 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:29.086094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:29.087750 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:29.094986 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:29.095656 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:29.096923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:29.097544 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:29.226551 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:29.234824 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:29.236311 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:29.237468 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-acc0fcef-e7c5-43a6-88d2-adcb665f068f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.155060 Oct 29 13:36:29.238065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 385/751] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:29 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:29.317121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:29.317727 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:29.323396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:29.323840 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:29.324604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:29.325037 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:29.509346 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:29.517428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4e36a001-30ad-4b39-9295-d447cb42754a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.203853 Oct 29 13:36:29.518151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 367/752] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:29 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:30.256755 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:30.257512 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:30.263524 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:30.264209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:30.265136 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:30.266198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:30.411674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:30.419954 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:30.421439 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:30.422657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fd966a96-6658-4c38-9a03-764ed4bce388 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.170296 Oct 29 13:36:30.423208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 386/753] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:30 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:30.536063 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:30.536905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:30.542652 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:30.543250 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:30.544014 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:30.544436 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:30.678021 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:30.685463 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ee151887-f6cd-4d6f-b7e6-cfb1f7c0bd15 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.153092 Oct 29 13:36:30.686363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 368/754] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:30 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:31.441474 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:31.442132 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:31.448365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:31.448805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:31.449572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:31.450252 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:31.623360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:31.632555 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:31.634090 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:31.635258 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ff122d25-81f3-4c63-82e6-d22b2eab3481 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.198373 Oct 29 13:36:31.635811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 387/755] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:31 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:31.704192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:31.704992 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:31.711449 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:31.711975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:31.712804 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:31.713300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:31.851955 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:31.862676 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2ec1ff22-0e45-473c-84bf-516469e1d956 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1674 microversion: 2.1 time: 0.163127 Oct 29 13:36:31.863248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 369/756] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:31 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:32.653660 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:32.654432 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:32.660711 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:32.661148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:32.661939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:32.662360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:32.787699 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:32.795694 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:32.797800 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:32.798974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-44fc9de4-d151-4b54-9fc7-b01154d53938 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.149000 Oct 29 13:36:32.799868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 388/757] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:32 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:32.879829 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:32.880378 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:32.886582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:32.887024 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:32.887770 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:32.888198 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:33.016958 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:33.025395 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4d5fa6dc-97f9-47d9-ab2a-b31b7de4df29 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1651 microversion: 2.1 time: 0.149193 Oct 29 13:36:33.025996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 370/758] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:32 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1651 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:33.041881 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ccb283eb-f2a5-44d8-b2fe-435fbe8a0d98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:33.047549 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ccb283eb-f2a5-44d8-b2fe-435fbe8a0d98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:33.047997 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ccb283eb-f2a5-44d8-b2fe-435fbe8a0d98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:33.070757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ccb283eb-f2a5-44d8-b2fe-435fbe8a0d98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Going to try to start instance {{(pid=122215) start /opt/stack/nova/nova/compute/api.py:2675}} Oct 29 13:36:33.111955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ccb283eb-f2a5-44d8-b2fe-435fbe8a0d98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action" status: 202 len: 0 microversion: 2.1 time: 0.073478 Oct 29 13:36:33.112959 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 389/759] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:36:33 2021] POST /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:36:33.120508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:33.121111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:33.127506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:33.127955 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:33.128775 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:33.129284 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:33.318492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:33.326443 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-249b1165-e791-44d3-b069-9c67760d3a0a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1660 microversion: 2.1 time: 0.209585 Oct 29 13:36:33.327753 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 371/760] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:33 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1660 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:33.820148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:33.820976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:33.827193 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:33.828088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:33.828988 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:33.829605 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:33.978673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:33.988344 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:33.990071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:33.991426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c97ecf15-c4f3-4898-a50e-17e9eb74d94c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1809 microversion: 2.20 time: 0.176077 Oct 29 13:36:33.991994 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 390/761] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:33 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:34.345164 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:34.345941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:34.352072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:34.352515 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:34.353523 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:34.353988 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:34.486772 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:34.493873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-958fe5e3-377e-4986-b7a0-7f743729059d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1660 microversion: 2.1 time: 0.153392 Oct 29 13:36:34.494433 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 372/762] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:34 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1660 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:35.010215 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:35.010840 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:35.017322 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:35.017922 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:35.018881 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:35.019347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:35.144030 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:35.153352 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:35.154907 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:35.156898 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e4277b36-2ea7-4689-8275-e93505fc76e9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1796 microversion: 2.20 time: 0.149687 Oct 29 13:36:35.157456 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 391/763] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:35 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1796 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:36:35.511043 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:35.511765 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:35.518996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:35.519532 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:35.520480 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:35.520917 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:35.644933 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:35.652525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-06abd42e-f1e4-4147-82c3-c6c2616f349c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1664 microversion: 2.1 time: 0.145541 Oct 29 13:36:35.653162 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 373/764] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:35 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1664 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:38.572064 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-610395890", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-36819492", "security_groups": [{"name": "tempest-secgroup-smoke-255641277"}], "block_device_mapping_v2": [{"uuid": "16d5cacd-ff3d-4019-b732-007f566ccf92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d620a326-cd97-4595-b325-2f417240582b"}]}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:38.671269 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] validate_networks() for [('d620a326-cd97-4595-b325-2f417240582b', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:36:39.023496 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:36:39.023853 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:36:39.024314 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:36:39.024715 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:36:39.025113 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:36:39.033706 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:39.034184 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:39.035053 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:39.035493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:39.052432 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for project dda9cf39e3ff4797af5227f990f14457. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:36:39.056253 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for user a1c8d9c5df1a447ea666d48b3a35ec96 and project dda9cf39e3ff4797af5227f990f14457. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:36:39.113472 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:36:39.115604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16d5cacd-ff3d-4019-b732-007f566ccf92',volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:36:39.236484 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6148b3cb-a9f6-42bf-bf22-47aecef5c576 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.668009 Oct 29 13:36:39.237284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 392/765] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:36:38 2021] POST /compute/v2.1/servers => generated 405 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:36:39.246618 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e5e3ce6a-49c5-40dd-ba07-6c03ddaaa17c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:39.247225 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e5e3ce6a-49c5-40dd-ba07-6c03ddaaa17c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:39.311479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e5e3ce6a-49c5-40dd-ba07-6c03ddaaa17c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:39.318974 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e5e3ce6a-49c5-40dd-ba07-6c03ddaaa17c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1092 microversion: 2.1 time: 0.075932 Oct 29 13:36:39.319726 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 374/766] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:39 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1092 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:36:40.335927 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:40.336612 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:40.342828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:40.343285 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:40.344087 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:40.344523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:40.413623 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:40.422210 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-38580909-cdec-4d72-8b83-f3c6f08ab230 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1208 microversion: 2.1 time: 0.089387 Oct 29 13:36:40.422784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 393/767] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:40 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:41.440017 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:41.441177 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:41.451805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:41.452251 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:41.453310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:41.453797 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:41.525084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-c539ee73-57b2-4e13-8673-c042475bd2ea req-34d3c5a3-3b71-4565-b02f-56199241f0f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e312109a-5d7f-40b7-a0f4-c652d210410a", "tag": "49fbc446-11dd-43aa-9ae2-5fca88cbf195"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:41.526813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:36:41.526813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:36:41.536220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-c539ee73-57b2-4e13-8673-c042475bd2ea req-34d3c5a3-3b71-4565-b02f-56199241f0f5 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:41.536657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-c539ee73-57b2-4e13-8673-c042475bd2ea req-34d3c5a3-3b71-4565-b02f-56199241f0f5 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:41.552214 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-c539ee73-57b2-4e13-8673-c042475bd2ea req-34d3c5a3-3b71-4565-b02f-56199241f0f5 service nova] Creating event network-changed:49fbc446-11dd-43aa-9ae2-5fca88cbf195 for instance e312109a-5d7f-40b7-a0f4-c652d210410a on hv-cinder-81588 Oct 29 13:36:41.557357 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-c539ee73-57b2-4e13-8673-c042475bd2ea req-34d3c5a3-3b71-4565-b02f-56199241f0f5 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036130 Oct 29 13:36:41.558482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 394/768] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:36:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:36:41.650663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:41.658742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b3dfc3cf-23b9-42e7-abe7-ac239a6aeef8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.223252 Oct 29 13:36:41.659358 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 375/769] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:41 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:42.676976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:42.678889 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:42.685826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:42.686351 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:42.687738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:42.688269 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:42.810273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:42.818280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-838b9e7e-149c-46d9-8bbe-383faa93939f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.145837 Oct 29 13:36:42.818858 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 395/770] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:42 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:43.834694 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:43.835299 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:43.841070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:43.841517 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:43.842312 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:43.842745 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:44.010410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:44.018214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-414e4b11-acd1-4110-bb87-a6ef93a93d75 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.187067 Oct 29 13:36:44.018786 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 376/771] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:43 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:45.035082 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:45.035851 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:45.041585 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:45.042056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:45.042815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:45.043263 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:45.163674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:45.173382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8587d3f4-f643-4692-ac34-9a502e9a6384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.142444 Oct 29 13:36:45.174086 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 396/772] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:45 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:46.190726 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:46.191338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:46.197246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:46.197692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:46.198490 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:46.198919 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:46.322974 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:46.332008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b82e395e-7fd5-4c9b-ae25-12a65860fb4d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.145113 Oct 29 13:36:46.332842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 377/773] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:46 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:36:47.348129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:47.348949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:47.355088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:47.355390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:47.356160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:47.356595 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:47.475429 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:47.482666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-574bfabd-0b44-496c-bfeb-c690a104f471 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.138200 Oct 29 13:36:47.483240 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 397/774] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:47 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:48.500478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:48.501071 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:48.506807 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:48.507242 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:48.507993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:48.508415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:48.625217 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:48.632330 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-50a8abc1-9943-44bf-b448-95d2b4966828 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.136231 Oct 29 13:36:48.632886 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 378/775] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:48 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:49.647989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:49.648625 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:49.654296 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:49.654748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:49.655489 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:49.656532 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:49.781463 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:49.789280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f2faf5fe-3cc5-45ae-8201-d57fba95c16c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.144875 Oct 29 13:36:49.789929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 398/776] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:49 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:50.804952 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:50.805593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:50.811187 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:50.811634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:50.812390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:50.812821 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:50.936486 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:50.943666 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1a7626d0-a1ef-4bea-afa2-9ae631ba3adb tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.142339 Oct 29 13:36:50.944231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 379/777] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:50 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:51.960181 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:51.960905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:51.968619 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:51.969101 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:51.970031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:51.970314 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:52.174649 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:52.183281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4161e7ba-81c3-4e18-96c0-a2628ff46fa8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.226764 Oct 29 13:36:52.183849 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 399/778] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:51 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:53.111414 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-f0e7d857-dcdd-4f7b-8557-8648f8c1d750 req-593726d6-8629-4463-bd72-c3daf732e36a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e312109a-5d7f-40b7-a0f4-c652d210410a", "name": "network-vif-plugged", "status": "completed", "tag": "49fbc446-11dd-43aa-9ae2-5fca88cbf195"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:53.114561 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:36:53.114561 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:36:53.135766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-f0e7d857-dcdd-4f7b-8557-8648f8c1d750 req-593726d6-8629-4463-bd72-c3daf732e36a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:53.136428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-f0e7d857-dcdd-4f7b-8557-8648f8c1d750 req-593726d6-8629-4463-bd72-c3daf732e36a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:53.149090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-f0e7d857-dcdd-4f7b-8557-8648f8c1d750 req-593726d6-8629-4463-bd72-c3daf732e36a service nova] Creating event network-vif-plugged:49fbc446-11dd-43aa-9ae2-5fca88cbf195 for instance e312109a-5d7f-40b7-a0f4-c652d210410a on hv-cinder-81588 Oct 29 13:36:53.155488 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-f0e7d857-dcdd-4f7b-8557-8648f8c1d750 req-593726d6-8629-4463-bd72-c3daf732e36a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048761 Oct 29 13:36:53.156728 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 380/779] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:36:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:36:53.201606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:53.203025 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:53.212760 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:53.213677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:53.214574 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:53.215020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:53.365958 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:53.373838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fb9ae4ee-6309-4159-81e5-48f0b950d7ca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.176952 Oct 29 13:36:53.386010 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 400/780] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:53 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:54.393095 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:54.393935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:54.400309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:54.401064 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:54.401955 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:54.402475 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:54.538634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:54.546548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b87bf25d-5f45-4fb1-a6bb-c68fe384b39d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1263 microversion: 2.1 time: 0.157308 Oct 29 13:36:54.547223 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 381/781] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:54 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:55.563618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:55.564273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:55.571085 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:55.571754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:55.572542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:55.572974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:55.699729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:55.707718 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1a354c31-bdf9-4ea5-bf3e-f5f0a30976b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1450 microversion: 2.1 time: 0.147806 Oct 29 13:36:55.708283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 401/782] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:55 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1450 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:36:55.723402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:55.724004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:55.730145 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:55.730597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:55.731381 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:55.731813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:55.854214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:55.861444 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-79f83f0a-eb79-45c3-afbe-5adad9ef72af tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1450 microversion: 2.1 time: 0.141631 Oct 29 13:36:55.862035 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 382/783] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:36:55 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1450 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:57.630554 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-78af85ab-043e-4937-986a-fb81d1aedd01 req-4acec320-e6b7-4439-bd25-d79c4730a2eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e312109a-5d7f-40b7-a0f4-c652d210410a", "tag": "49fbc446-11dd-43aa-9ae2-5fca88cbf195"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:36:57.635818 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:36:57.635818 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:36:57.644141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-78af85ab-043e-4937-986a-fb81d1aedd01 req-4acec320-e6b7-4439-bd25-d79c4730a2eb service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:57.644580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-78af85ab-043e-4937-986a-fb81d1aedd01 req-4acec320-e6b7-4439-bd25-d79c4730a2eb service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:57.655289 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-78af85ab-043e-4937-986a-fb81d1aedd01 req-4acec320-e6b7-4439-bd25-d79c4730a2eb service nova] Creating event network-changed:49fbc446-11dd-43aa-9ae2-5fca88cbf195 for instance e312109a-5d7f-40b7-a0f4-c652d210410a on hv-cinder-81588 Oct 29 13:36:57.660389 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-78af85ab-043e-4937-986a-fb81d1aedd01 req-4acec320-e6b7-4439-bd25-d79c4730a2eb service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033524 Oct 29 13:36:57.661434 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 402/784] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:36:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:36:57.995767 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e83b15b6-ab44-4409-8cf2-4cb5bd599bf7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:57.996368 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e83b15b6-ab44-4409-8cf2-4cb5bd599bf7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:58.004020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e83b15b6-ab44-4409-8cf2-4cb5bd599bf7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:58.005043 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e83b15b6-ab44-4409-8cf2-4cb5bd599bf7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:58.006188 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e83b15b6-ab44-4409-8cf2-4cb5bd599bf7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:58.006862 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e83b15b6-ab44-4409-8cf2-4cb5bd599bf7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:58.037572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e83b15b6-ab44-4409-8cf2-4cb5bd599bf7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments/a525cf06-a766-4039-a59f-a7473aee12fd" status: 200 len: 194 microversion: 2.20 time: 0.045773 Oct 29 13:36:58.038468 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 383/785] 10.222.0.96 () {60 vars in 1453 bytes} [Fri Oct 29 13:36:57 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments/a525cf06-a766-4039-a59f-a7473aee12fd => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:36:58.118094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:58.118942 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:58.126225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:58.126900 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:58.127899 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:58.128516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:58.226323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lazy-loading 'services' on Instance uuid 27c9284f-a335-4a48-9c8b-5e1572d12240 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:36:58.297301 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-71f77e25-6f83-436c-b77a-f33e5a26f985 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments/a525cf06-a766-4039-a59f-a7473aee12fd" status: 202 len: 0 microversion: 2.20 time: 0.184059 Oct 29 13:36:58.298598 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 403/786] 10.222.0.96 () {60 vars in 1456 bytes} [Fri Oct 29 13:36:58 2021] DELETE /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments/a525cf06-a766-4039-a59f-a7473aee12fd => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:36:58.307388 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a8c1aca9-38fa-49f8-ad5c-14862250573d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:58.314157 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a8c1aca9-38fa-49f8-ad5c-14862250573d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:58.322157 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a8c1aca9-38fa-49f8-ad5c-14862250573d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:58.322881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a8c1aca9-38fa-49f8-ad5c-14862250573d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:58.324687 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a8c1aca9-38fa-49f8-ad5c-14862250573d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:58.325132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a8c1aca9-38fa-49f8-ad5c-14862250573d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:58.361093 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a8c1aca9-38fa-49f8-ad5c-14862250573d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058111 Oct 29 13:36:58.361950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 384/787] 10.222.0.96 () {60 vars in 1342 bytes} [Fri Oct 29 13:36:58 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:36:59.372892 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1d143c8b-bd21-46d6-a920-4793d2b1d35c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:59.373900 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1d143c8b-bd21-46d6-a920-4793d2b1d35c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:59.380155 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d143c8b-bd21-46d6-a920-4793d2b1d35c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:59.380596 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d143c8b-bd21-46d6-a920-4793d2b1d35c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:59.381344 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d143c8b-bd21-46d6-a920-4793d2b1d35c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:59.381766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1d143c8b-bd21-46d6-a920-4793d2b1d35c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:59.413137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1d143c8b-bd21-46d6-a920-4793d2b1d35c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044209 Oct 29 13:36:59.413698 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 404/788] 10.222.0.96 () {60 vars in 1342 bytes} [Fri Oct 29 13:36:59 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:36:59.472601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:59.473096 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:59.478769 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:59.479216 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:59.479977 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:59.480407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:59.506636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:36:59.577479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3288bc1d-67b5-4920-b336-ee1943af2238 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 204 len: 0 microversion: 2.20 time: 0.108198 Oct 29 13:36:59.578642 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 385/789] 10.222.0.96 () {60 vars in 1279 bytes} [Fri Oct 29 13:36:59 2021] DELETE /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 13:36:59.588687 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:36:59.589299 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:36:59.594961 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:59.595415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:59.596175 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:36:59.596688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:36:59.719702 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:59.727951 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:59.729809 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:36:59.731319 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d090e866-9e02-47f0-901c-690d5a95910b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.147887 Oct 29 13:36:59.731906 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 405/790] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:36:59 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:00.751965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:00.752683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:00.758857 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:00.759326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:00.760100 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:00.760529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:00.878962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:00.887935 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:00.889576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:00.891308 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9625323e-bd64-47d9-8be7-1c85cdd8c988 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.144746 Oct 29 13:37:00.891867 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 386/791] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:00 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:01.909752 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:01.910514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:01.916744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:01.917461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:01.919457 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:01.920104 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:02.115101 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:02.125496 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:02.127315 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:02.128516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2f4f3b68-dc28-44f0-a8aa-186b58fbcfb6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1724 microversion: 2.20 time: 0.222786 Oct 29 13:37:02.129067 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 406/792] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:01 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:02.932787 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-cbe00d2d-985b-4855-9cd6-79ddc21a8123 req-ae54f609-1b02-4b25-8baf-744eed7ba9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c9284f-a335-4a48-9c8b-5e1572d12240", "name": "network-vif-deleted", "tag": "d49765ad-79cc-45ce-898a-88b1395fa0fb"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:02.934540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:02.934540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:37:02.946373 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-cbe00d2d-985b-4855-9cd6-79ddc21a8123 req-ae54f609-1b02-4b25-8baf-744eed7ba9d7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:02.947260 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-cbe00d2d-985b-4855-9cd6-79ddc21a8123 req-ae54f609-1b02-4b25-8baf-744eed7ba9d7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:02.962182 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-cbe00d2d-985b-4855-9cd6-79ddc21a8123 req-ae54f609-1b02-4b25-8baf-744eed7ba9d7 service nova] Creating event network-vif-deleted:d49765ad-79cc-45ce-898a-88b1395fa0fb for instance 27c9284f-a335-4a48-9c8b-5e1572d12240 on hv-cinder-81588 Oct 29 13:37:02.970129 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-cbe00d2d-985b-4855-9cd6-79ddc21a8123 req-ae54f609-1b02-4b25-8baf-744eed7ba9d7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041767 Oct 29 13:37:02.977926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 387/793] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:03.146960 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:03.147564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:03.159580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:03.160031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:03.160811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:03.161239 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:03.230868 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:03.231679 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:03.232096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lazy-loading 'fault' on Instance uuid 27c9284f-a335-4a48-9c8b-5e1572d12240 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:37:03.280204 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:03.288910 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:03.292521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:03.294122 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-453f8ba2-2c51-438b-8cbc-c2d986be56ba tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 200 len: 1371 microversion: 2.20 time: 0.150968 Oct 29 13:37:03.295435 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 407/794] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:03 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:04.313044 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:04.313755 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:04.320390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:04.321151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:04.322082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:04.322548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:04.336683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] HTTP exception thrown: Instance 27c9284f-a335-4a48-9c8b-5e1572d12240 could not be found. Oct 29 13:37:04.337281 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Returning 404 to user: Instance 27c9284f-a335-4a48-9c8b-5e1572d12240 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:37:04.338131 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-de1865ae-3adc-4dbf-8f33-75b5d38b65e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 404 len: 111 microversion: 2.20 time: 0.029421 Oct 29 13:37:04.338672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 388/795] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:04 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 13:37:04.348134 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ba9b6c4e-95cc-41eb-8020-7de65362f818 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '.version_select at 0x7f54800ae1f0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:04.373124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ba9b6c4e-95cc-41eb-8020-7de65362f818 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921991843" status: 204 len: 0 microversion: 2.20 time: 0.028626 Oct 29 13:37:04.373867 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 408/796] 10.222.0.96 () {60 vars in 1258 bytes} [Fri Oct 29 13:37:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921991843 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 13:37:05.091639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7b86c91d-fa8d-4a9e-81bc-3acfec733f0e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'create', calling method: .version_select at 0x7f547c28cc10>, body: {"keypair": {"name": "tempest-keypair-327066438"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:05.109071 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7b86c91d-fa8d-4a9e-81bc-3acfec733f0e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:05.113015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7b86c91d-fa8d-4a9e-81bc-3acfec733f0e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for user 4e9e6a65d8804e74b5e939ed1d4be645 and project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:05.434209 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7b86c91d-fa8d-4a9e-81bc-3acfec733f0e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:05.438336 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7b86c91d-fa8d-4a9e-81bc-3acfec733f0e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for user 4e9e6a65d8804e74b5e939ed1d4be645 and project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:05.451565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7b86c91d-fa8d-4a9e-81bc-3acfec733f0e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.363641 Oct 29 13:37:05.452149 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 389/797] 10.222.0.96 () {62 vars in 1198 bytes} [Fri Oct 29 13:37:05 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 365 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Oct 29 13:37:06.732349 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-570863107", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0342d3e5-b15b-4d7b-9252-6c7510cc9cfa"}], "security_groups": [{"name": "tempest-securitygroup--722667093"}], "key_name": "tempest-keypair-327066438", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:06.825310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] validate_networks() for [('0342d3e5-b15b-4d7b-9252-6c7510cc9cfa', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:37:07.189275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:37:07.189698 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:37:07.190389 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:37:07.190794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:37:07.191202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:37:07.199642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:07.200087 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:07.200887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:07.201320 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:07.217379 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:07.221235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Getting quotas for user 4e9e6a65d8804e74b5e939ed1d4be645 and project 7a7750e1de6f482ebcfe89e9ad577e0c. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:07.234142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:37:07.236581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:37:07.281877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4a07be37-e27a-4e38-aaf4-f1d34cc58cb8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.553655 Oct 29 13:37:07.282512 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 409/798] 10.222.0.96 () {62 vars in 1187 bytes} [Fri Oct 29 13:37:06 2021] POST /compute/v2.1/servers => generated 401 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 29 13:37:07.292469 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-18527800-2159-4d0f-8d2d-a9d9ec4550bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:07.293087 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-18527800-2159-4d0f-8d2d-a9d9ec4550bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:07.348506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-18527800-2159-4d0f-8d2d-a9d9ec4550bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:07.357069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-18527800-2159-4d0f-8d2d-a9d9ec4550bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:07.358643 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-18527800-2159-4d0f-8d2d-a9d9ec4550bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:07.359712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-18527800-2159-4d0f-8d2d-a9d9ec4550bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1280 microversion: 2.20 time: 0.071044 Oct 29 13:37:07.360254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 390/799] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:07 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1280 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:37:08.378313 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:08.378920 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:08.384872 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:08.385319 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:08.386110 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:08.386543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:08.444843 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:08.452413 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:08.453923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:08.455020 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0911ca49-ef57-4abe-8b18-3f1d6de08c14 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1284 microversion: 2.20 time: 0.081211 Oct 29 13:37:08.455573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 410/800] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:08 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1284 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:09.472480 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:09.473083 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:09.479035 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:09.479480 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:09.480255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:09.480689 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:09.543565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:09.552400 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:09.553974 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:09.555156 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-58d37fa9-44dd-46c6-9b05-9a7a568a524e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1332 microversion: 2.20 time: 0.086313 Oct 29 13:37:09.555697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 391/801] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:09 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:10.573763 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:10.575118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:10.581031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:10.581475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:10.582282 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:10.582717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:10.710471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:10.718728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:10.720206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:10.721515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9920c601-f301-4df7-a7a6-5771c33ac5f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.151505 Oct 29 13:37:10.722096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 411/802] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:10 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:11.153934 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-9891b854-9c08-4471-868a-c14ed206dbad req-dd567c57-c653-41ce-8434-24ed80b9108c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c9065a-62c0-4f58-82af-bd44e7a1ac45", "tag": "207037ea-0c28-45f2-b0bb-bf243c80aa97"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:11.160811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:11.160811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:37:11.166342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee986980-28fe-4937-9232-4ce5056cf12d] AMQP server on 10.222.0.96:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 13:37:11.179881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-9891b854-9c08-4471-868a-c14ed206dbad req-dd567c57-c653-41ce-8434-24ed80b9108c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:11.180324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-9891b854-9c08-4471-868a-c14ed206dbad req-dd567c57-c653-41ce-8434-24ed80b9108c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:11.192773 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-9891b854-9c08-4471-868a-c14ed206dbad req-dd567c57-c653-41ce-8434-24ed80b9108c service nova] Creating event network-changed:207037ea-0c28-45f2-b0bb-bf243c80aa97 for instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 on hv-cinder-81588 Oct 29 13:37:11.197751 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-9891b854-9c08-4471-868a-c14ed206dbad req-dd567c57-c653-41ce-8434-24ed80b9108c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049397 Oct 29 13:37:11.198751 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 392/803] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:11.739740 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:11.740368 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:11.746074 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:11.746519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:11.747298 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:11.747725 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:11.872202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:11.880666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:11.882493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:11.883577 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3fc73092-e573-4885-b67c-f6b36c02a1cf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.147632 Oct 29 13:37:11.884333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 412/804] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:11 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:12.900758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:12.901551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:12.918873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:12.919338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:12.920080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:12.920501 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:12.925596 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee986980-28fe-4937-9232-4ce5056cf12d] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 34626. Oct 29 13:37:13.079077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:13.087209 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:13.088712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:13.089850 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1616b73c-1497-40df-850d-47565a2af067 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.193055 Oct 29 13:37:13.090404 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 393/805] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:12 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:14.108360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:14.109171 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:14.115337 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:14.115784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:14.116563 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:14.117507 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:14.357080 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:14.365662 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:14.367314 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:14.368626 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a0fc1d77-bc95-4682-81c6-f80bdb9ce068 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.264804 Oct 29 13:37:14.369265 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 413/806] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:14 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:15.386189 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:15.386823 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:15.393074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:15.393525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:15.394595 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:15.394837 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:15.569635 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:15.578483 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:15.580463 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:15.582531 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-294265ba-29fa-4f5c-b9e2-cda35a5491f3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.200097 Oct 29 13:37:15.584412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 394/807] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:15 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:16.601659 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:16.603442 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:16.611274 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:16.611939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:16.612709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:16.613129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:16.766009 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:16.780667 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:16.783079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:16.784341 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ab1e314c-e9aa-4fd2-986e-d9194a2a1ec7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.186733 Oct 29 13:37:16.785759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 414/808] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:16 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:17.802680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:17.803277 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:17.809409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:17.809902 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:17.810921 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:17.811472 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:18.037265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:18.051565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:18.057752 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:18.058943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2ab5d3e7-9d01-4c75-93f4-ed1264c7bd5a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.259983 Oct 29 13:37:18.069187 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 395/809] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:17 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:37:19.079011 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:19.079618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:19.085415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:19.085890 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:19.086663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:19.087256 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:19.317995 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:19.325636 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:19.327260 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:19.328368 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-18d53c98-67b8-4af1-b564-0e25573009a8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.253649 Oct 29 13:37:19.328924 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 415/810] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:19 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:37:19.766302 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5dee0c91-8be5-4619-86a6-733bce55d852 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:19.767381 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5dee0c91-8be5-4619-86a6-733bce55d852 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:19.777665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dee0c91-8be5-4619-86a6-733bce55d852 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:19.780743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dee0c91-8be5-4619-86a6-733bce55d852 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:19.781723 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dee0c91-8be5-4619-86a6-733bce55d852 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:19.782345 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dee0c91-8be5-4619-86a6-733bce55d852 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:19.844103 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5dee0c91-8be5-4619-86a6-733bce55d852 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082620 Oct 29 13:37:19.847178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 396/811] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:37:19 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:37:19.941737 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:19.942270 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:19.951325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:19.959049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:19.959877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:19.960309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:20.045615 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-8016ed82-9238-46ca-84b3-5b74dcbae8af req-5126e7a4-19dc-4943-bae3-44917d519853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c9065a-62c0-4f58-82af-bd44e7a1ac45", "name": "network-vif-plugged", "status": "completed", "tag": "207037ea-0c28-45f2-b0bb-bf243c80aa97"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:20.047885 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:20.047885 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:37:20.054364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:37:20.067489 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-8016ed82-9238-46ca-84b3-5b74dcbae8af req-5126e7a4-19dc-4943-bae3-44917d519853 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:20.068669 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-8016ed82-9238-46ca-84b3-5b74dcbae8af req-5126e7a4-19dc-4943-bae3-44917d519853 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:20.087753 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-8016ed82-9238-46ca-84b3-5b74dcbae8af req-5126e7a4-19dc-4943-bae3-44917d519853 service nova] Creating event network-vif-plugged:207037ea-0c28-45f2-b0bb-bf243c80aa97 for instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 on hv-cinder-81588 Oct 29 13:37:20.103610 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-8016ed82-9238-46ca-84b3-5b74dcbae8af req-5126e7a4-19dc-4943-bae3-44917d519853 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061486 Oct 29 13:37:20.104467 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 397/812] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:20.229684 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a60d2158-f82e-47b8-a0cb-35250febe6b1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 204 len: 0 microversion: 2.1 time: 0.291214 Oct 29 13:37:20.230383 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 416/813] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:37:19 2021] DELETE /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:37:20.240265 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:20.241348 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:20.250049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:20.250896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:20.252268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:20.252971 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:20.349055 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:20.349828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:20.361031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:20.361533 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:20.362351 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:20.362959 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:20.606419 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:20.616301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e9c8bdd9-50ce-4e3c-8d99-ca5f5ecad474 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1670 microversion: 2.1 time: 0.381256 Oct 29 13:37:20.626549 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 398/814] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:20 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1670 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:20.704026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:20.717977 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:20.719577 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:20.722323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d1a21fd3-af92-4229-8e2d-bf421e0c6f31 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.379074 Oct 29 13:37:20.725101 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 417/815] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:20 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:37:21.632560 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:21.633353 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:21.640615 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:21.641069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:21.645868 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:21.646423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:21.742254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:21.742865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:21.756919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:21.757437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:21.758321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:21.758909 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:21.957536 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:21.965835 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-483bbaf1-5916-48df-a27d-5919e40fcbec tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1670 microversion: 2.1 time: 0.336717 Oct 29 13:37:21.973143 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 399/816] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:21 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1670 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:22.260988 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:22.272860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:22.275336 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:22.276464 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a5ee4ad9-83e8-4bb8-b46a-5dbb71caef1c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1405 microversion: 2.20 time: 0.538042 Oct 29 13:37:22.277016 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 418/817] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:21 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1405 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:37:22.983956 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:22.984580 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:22.990922 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:22.991446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:22.992281 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:22.992947 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:23.295405 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:23.296779 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:23.302934 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:23.303314 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:23.304499 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:23.305438 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:23.387547 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:23.395277 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f154c2bc-5533-4ebf-927e-2dcde700163d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1670 microversion: 2.1 time: 0.415614 Oct 29 13:37:23.396047 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 400/818] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:22 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1670 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:23.644774 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:23.659323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:23.661650 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:23.663523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e01622ad-318b-4298-9081-6349985bca4f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1597 microversion: 2.20 time: 0.372347 Oct 29 13:37:23.664672 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 419/819] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:37:23 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1597 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:37:23.681900 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-61ef8745-d046-4bc7-bd8f-cc26a5bed396 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:23.683775 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-61ef8745-d046-4bc7-bd8f-cc26a5bed396 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:23.690127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-61ef8745-d046-4bc7-bd8f-cc26a5bed396 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:23.690687 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-61ef8745-d046-4bc7-bd8f-cc26a5bed396 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:23.691535 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-61ef8745-d046-4bc7-bd8f-cc26a5bed396 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:23.692040 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-61ef8745-d046-4bc7-bd8f-cc26a5bed396 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:23.782739 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-61ef8745-d046-4bc7-bd8f-cc26a5bed396 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.104877 Oct 29 13:37:23.783330 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 401/820] 10.222.0.96 () {60 vars in 1315 bytes} [Fri Oct 29 13:37:23 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:37:24.011426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-39363f2c-1c8d-49bc-ad9f-f627432d9d09 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Action: 'create', calling method: .version_select at 0x7f54800ae670>, body: {"keypair": {"name": "tempest-TestShelveInstance-383892962"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:24.029450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-39363f2c-1c8d-49bc-ad9f-f627432d9d09 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Getting quotas for project 01041e00f28e4197a613ed2b47866c73. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:24.033478 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-39363f2c-1c8d-49bc-ad9f-f627432d9d09 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Getting quotas for user 2e9366dec6d04ecdb0574a2d2e812a51 and project 01041e00f28e4197a613ed2b47866c73. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:24.198169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-39363f2c-1c8d-49bc-ad9f-f627432d9d09 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Getting quotas for project 01041e00f28e4197a613ed2b47866c73. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:24.201943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-39363f2c-1c8d-49bc-ad9f-f627432d9d09 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Getting quotas for user 2e9366dec6d04ecdb0574a2d2e812a51 and project 01041e00f28e4197a613ed2b47866c73. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:24.215438 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-39363f2c-1c8d-49bc-ad9f-f627432d9d09 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.336382 Oct 29 13:37:24.216241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 420/821] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Oct 29 13:37:23 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:24.413357 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:24.414898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:24.422953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:24.423798 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:24.425287 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:24.426052 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:24.651824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:24.664753 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-df41d2ad-6e19-4ad2-a22c-d6aa53d945ad tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1670 microversion: 2.1 time: 0.255413 Oct 29 13:37:24.670517 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 402/822] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:24 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1670 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:25.091631 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1002ecb5-03db-47eb-a32b-a35bf880fea7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:25.092592 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1002ecb5-03db-47eb-a32b-a35bf880fea7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:25.097973 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-480aff62-978e-4d92-b5df-609b33c55dbb req-e13b2a24-d266-433a-8600-df7d11f0b76f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9c9065a-62c0-4f58-82af-bd44e7a1ac45", "tag": "207037ea-0c28-45f2-b0bb-bf243c80aa97"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:25.099462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:25.099462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:37:25.100262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1002ecb5-03db-47eb-a32b-a35bf880fea7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:25.100967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1002ecb5-03db-47eb-a32b-a35bf880fea7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:25.102913 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1002ecb5-03db-47eb-a32b-a35bf880fea7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:25.104033 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1002ecb5-03db-47eb-a32b-a35bf880fea7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:25.106431 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-480aff62-978e-4d92-b5df-609b33c55dbb req-e13b2a24-d266-433a-8600-df7d11f0b76f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:25.107133 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-480aff62-978e-4d92-b5df-609b33c55dbb req-e13b2a24-d266-433a-8600-df7d11f0b76f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:25.132693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-480aff62-978e-4d92-b5df-609b33c55dbb req-e13b2a24-d266-433a-8600-df7d11f0b76f service nova] Creating event network-changed:207037ea-0c28-45f2-b0bb-bf243c80aa97 for instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 on hv-cinder-81588 Oct 29 13:37:25.155779 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-480aff62-978e-4d92-b5df-609b33c55dbb req-e13b2a24-d266-433a-8600-df7d11f0b76f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060199 Oct 29 13:37:25.157975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 403/823] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:25.423754 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1002ecb5-03db-47eb-a32b-a35bf880fea7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.335634 Oct 29 13:37:25.425144 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 421/824] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:25 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:25.683389 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:25.684691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:25.699736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:25.700206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:25.701016 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:25.707706 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:25.854059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-1ff71a18-1d1b-43cc-9947-3a05ef6c861d req-4d501e36-473f-424d-9f48-7bbcf922e14a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3514ebdc-efef-4212-a080-cb9e0f9c7cc4", "name": "network-vif-unplugged", "status": "completed", "tag": "297f0860-5eca-4489-80dd-06a64c0f02df"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:25.855647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:25.855647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:37:25.877497 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-1ff71a18-1d1b-43cc-9947-3a05ef6c861d req-4d501e36-473f-424d-9f48-7bbcf922e14a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:25.881453 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-1ff71a18-1d1b-43cc-9947-3a05ef6c861d req-4d501e36-473f-424d-9f48-7bbcf922e14a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:25.915736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-1ff71a18-1d1b-43cc-9947-3a05ef6c861d req-4d501e36-473f-424d-9f48-7bbcf922e14a service nova] Creating event network-vif-unplugged:297f0860-5eca-4489-80dd-06a64c0f02df for instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 on hv-cinder-81588 Oct 29 13:37:25.932287 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-1ff71a18-1d1b-43cc-9947-3a05ef6c861d req-4d501e36-473f-424d-9f48-7bbcf922e14a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083153 Oct 29 13:37:25.937974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 422/825] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:25 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:26.420015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:26.433372 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ba202d4e-69bf-4180-8920-e9b226231755 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1670 microversion: 2.1 time: 0.753706 Oct 29 13:37:26.434327 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 404/826] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:25 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1670 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:26.444753 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2bd09a4f-172d-4063-8a62-8955842b0f8b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:26.445889 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2bd09a4f-172d-4063-8a62-8955842b0f8b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:26.461967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bd09a4f-172d-4063-8a62-8955842b0f8b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:26.463025 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bd09a4f-172d-4063-8a62-8955842b0f8b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:26.464765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bd09a4f-172d-4063-8a62-8955842b0f8b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:26.467629 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bd09a4f-172d-4063-8a62-8955842b0f8b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:26.555462 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2bd09a4f-172d-4063-8a62-8955842b0f8b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.120187 Oct 29 13:37:26.560261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 423/827] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:26 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:26.932756 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-e1ce13b0-5881-4c84-a7d2-a50d3ad033e0 req-e0887ce1-4ac5-46c8-93de-c753389c8537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3514ebdc-efef-4212-a080-cb9e0f9c7cc4", "name": "network-vif-deleted", "tag": "297f0860-5eca-4489-80dd-06a64c0f02df"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:26.934409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:26.934409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:37:26.944771 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e1ce13b0-5881-4c84-a7d2-a50d3ad033e0 req-e0887ce1-4ac5-46c8-93de-c753389c8537 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:26.945399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e1ce13b0-5881-4c84-a7d2-a50d3ad033e0 req-e0887ce1-4ac5-46c8-93de-c753389c8537 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:26.956926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-e1ce13b0-5881-4c84-a7d2-a50d3ad033e0 req-e0887ce1-4ac5-46c8-93de-c753389c8537 service nova] Creating event network-vif-deleted:297f0860-5eca-4489-80dd-06a64c0f02df for instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 on hv-cinder-81588 Oct 29 13:37:26.964760 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-e1ce13b0-5881-4c84-a7d2-a50d3ad033e0 req-e0887ce1-4ac5-46c8-93de-c753389c8537 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035530 Oct 29 13:37:26.973588 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 405/828] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:27.452033 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:27.452890 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:27.459708 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:27.460486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:27.461468 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:27.462146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:27.494078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:27.494793 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:27.495239 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lazy-loading 'fault' on Instance uuid 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:37:27.537015 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:27.543613 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-86b2d7a3-17f2-4670-9cad-372c7e2e94b0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 200 len: 1325 microversion: 2.1 time: 0.095904 Oct 29 13:37:27.544387 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 424/829] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:27 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 1325 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:27.570780 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cc389101-c225-4116-baae-3b018cd2f12a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:27.571987 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cc389101-c225-4116-baae-3b018cd2f12a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:27.579725 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc389101-c225-4116-baae-3b018cd2f12a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:27.580553 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc389101-c225-4116-baae-3b018cd2f12a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:27.581608 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc389101-c225-4116-baae-3b018cd2f12a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:27.582145 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc389101-c225-4116-baae-3b018cd2f12a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:27.642775 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cc389101-c225-4116-baae-3b018cd2f12a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.075686 Oct 29 13:37:27.645802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 406/830] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:27 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:28.562822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:28.564083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:28.570904 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:28.571351 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:28.572127 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:28.572552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:28.586952 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] HTTP exception thrown: Instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 could not be found. Oct 29 13:37:28.587686 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Returning 404 to user: Instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:37:28.588513 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9a43cf3a-04f3-4b63-831f-f64bdb57612c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 404 len: 111 microversion: 2.1 time: 0.029490 Oct 29 13:37:28.589054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 425/831] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:28 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:37:28.598727 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ffc887ca-4f14-46d4-be4d-8fa64dbda11a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '.version_select at 0x7f547c1ea9d0>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:28.623033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ffc887ca-4f14-46d4-be4d-8fa64dbda11a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-69742292" status: 202 len: 0 microversion: 2.1 time: 0.028384 Oct 29 13:37:28.623708 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 407/832] 10.222.0.96 () {58 vars in 1214 bytes} [Fri Oct 29 13:37:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-69742292 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:28.656984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d59a15d1-2e52-4b2a-9302-36246637f800 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:28.660074 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d59a15d1-2e52-4b2a-9302-36246637f800 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:28.674530 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d59a15d1-2e52-4b2a-9302-36246637f800 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:28.675051 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d59a15d1-2e52-4b2a-9302-36246637f800 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:28.675853 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d59a15d1-2e52-4b2a-9302-36246637f800 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:28.676288 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d59a15d1-2e52-4b2a-9302-36246637f800 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:28.739525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d59a15d1-2e52-4b2a-9302-36246637f800 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.088574 Oct 29 13:37:28.742750 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 426/833] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:28 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:29.317376 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7c4384c2-7ced-4922-8716-0d2387ee1299 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'create', calling method: .version_select at 0x7f547c214670>, body: {"keypair": {"name": "tempest-keypair-288105848"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:29.335973 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7c4384c2-7ced-4922-8716-0d2387ee1299 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:29.340719 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7c4384c2-7ced-4922-8716-0d2387ee1299 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for user 22a929341e7342ea9ad10ff06b40fbf6 and project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:29.556378 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7c4384c2-7ced-4922-8716-0d2387ee1299 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:29.560434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-7c4384c2-7ced-4922-8716-0d2387ee1299 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for user 22a929341e7342ea9ad10ff06b40fbf6 and project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'key_pairs'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:29.573681 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7c4384c2-7ced-4922-8716-0d2387ee1299 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.259954 Oct 29 13:37:29.574672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 408/834] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Oct 29 13:37:29 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:29.751901 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c6125f34-751a-496b-80d6-1ebd16293e8a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:29.753729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c6125f34-751a-496b-80d6-1ebd16293e8a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:29.762674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6125f34-751a-496b-80d6-1ebd16293e8a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:29.763256 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6125f34-751a-496b-80d6-1ebd16293e8a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:29.764075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6125f34-751a-496b-80d6-1ebd16293e8a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:29.764667 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6125f34-751a-496b-80d6-1ebd16293e8a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:29.831523 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c6125f34-751a-496b-80d6-1ebd16293e8a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.084642 Oct 29 13:37:29.832369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 427/835] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:29 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:30.843725 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-db54cfb5-6c54-4551-93ef-a643699fa5b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:30.844750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-db54cfb5-6c54-4551-93ef-a643699fa5b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:30.851066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db54cfb5-6c54-4551-93ef-a643699fa5b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:30.851656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db54cfb5-6c54-4551-93ef-a643699fa5b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:30.852438 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db54cfb5-6c54-4551-93ef-a643699fa5b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:30.852871 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-db54cfb5-6c54-4551-93ef-a643699fa5b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:30.910308 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-db54cfb5-6c54-4551-93ef-a643699fa5b0 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.071175 Oct 29 13:37:30.911188 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 409/836] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:30 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:30.997176 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-655268936", "imageRef": "7c63edc7-8a99-4a42-9cd1-35fb721105dc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b00fe28-a5bb-47a1-b3da-ae5774a84660"}], "security_groups": [{"name": "tempest-securitygroup--720901943"}], "key_name": "tempest-keypair-288105848", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:31.088772 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] validate_networks() for [('9b00fe28-a5bb-47a1-b3da-ae5774a84660', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:37:31.525237 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:37:31.525736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:37:31.526245 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:37:31.526659 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:37:31.527071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:37:31.536019 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:31.536461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:31.537360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:31.537825 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:31.553975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:31.557888 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Getting quotas for user 22a929341e7342ea9ad10ff06b40fbf6 and project 2f8248bc18c44ce3a53d399a2faba011. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:31.570164 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:37:31.572573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c63edc7-8a99-4a42-9cd1-35fb721105dc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:37:31.627536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e2cdc140-8b9c-4f09-a985-b6dd9f72bf39 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.635788 Oct 29 13:37:31.628790 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 428/837] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:37:30 2021] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:37:31.640225 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-16d92973-85ca-49ad-adba-0e2eaccc13d5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:31.641266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-16d92973-85ca-49ad-adba-0e2eaccc13d5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:31.712225 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-16d92973-85ca-49ad-adba-0e2eaccc13d5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:31.719495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-16d92973-85ca-49ad-adba-0e2eaccc13d5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1236 microversion: 2.1 time: 0.084265 Oct 29 13:37:31.720399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 410/838] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:31 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1236 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:31.924761 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f86b7852-d9c5-467f-ba3a-49f762e44990 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:31.926113 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f86b7852-d9c5-467f-ba3a-49f762e44990 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:31.934501 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f86b7852-d9c5-467f-ba3a-49f762e44990 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:31.935593 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f86b7852-d9c5-467f-ba3a-49f762e44990 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:31.937242 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f86b7852-d9c5-467f-ba3a-49f762e44990 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:31.938122 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f86b7852-d9c5-467f-ba3a-49f762e44990 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:32.019278 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f86b7852-d9c5-467f-ba3a-49f762e44990 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.100000 Oct 29 13:37:32.022738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 429/839] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:31 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:32.736387 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:32.738814 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:32.751845 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:32.752673 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:32.754379 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:32.755050 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:32.877575 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:32.892222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2f313be8-3634-4940-86d0-9a4b19698db4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1296 microversion: 2.1 time: 0.159686 Oct 29 13:37:32.893038 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 411/840] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:32 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:33.033583 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ba41b659-4fc8-46b1-b083-37bc59b0f79d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:33.034953 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ba41b659-4fc8-46b1-b083-37bc59b0f79d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:33.043281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba41b659-4fc8-46b1-b083-37bc59b0f79d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:33.045919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba41b659-4fc8-46b1-b083-37bc59b0f79d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:33.048433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba41b659-4fc8-46b1-b083-37bc59b0f79d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:33.049667 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba41b659-4fc8-46b1-b083-37bc59b0f79d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:33.125356 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ba41b659-4fc8-46b1-b083-37bc59b0f79d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.098194 Oct 29 13:37:33.126410 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 430/841] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:33 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:33.932437 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:33.933040 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:33.949195 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:33.949977 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:33.951001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:33.951900 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:34.137047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-66d79df1-9887-47e0-b3f9-ea31ff606dec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:34.138678 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-66d79df1-9887-47e0-b3f9-ea31ff606dec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:34.153547 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-66d79df1-9887-47e0-b3f9-ea31ff606dec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:34.164733 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-66d79df1-9887-47e0-b3f9-ea31ff606dec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:34.165715 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-66d79df1-9887-47e0-b3f9-ea31ff606dec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:34.166208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-66d79df1-9887-47e0-b3f9-ea31ff606dec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:34.277248 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-66d79df1-9887-47e0-b3f9-ea31ff606dec tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.143719 Oct 29 13:37:34.278775 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 431/842] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:34 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:34.293055 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-78a61a82-24ed-417a-b0f8-5997cde836c0 req-cdb5c6a6-d9bb-447c-a440-7fdc5e691647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4", "tag": "bbd097dd-ea19-4a4e-a3ed-ffc024cf517d"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:34.296405 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:34.296405 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:37:34.308249 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-78a61a82-24ed-417a-b0f8-5997cde836c0 req-cdb5c6a6-d9bb-447c-a440-7fdc5e691647 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:34.308454 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-78a61a82-24ed-417a-b0f8-5997cde836c0 req-cdb5c6a6-d9bb-447c-a440-7fdc5e691647 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:34.322500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-78a61a82-24ed-417a-b0f8-5997cde836c0 req-cdb5c6a6-d9bb-447c-a440-7fdc5e691647 service nova] Creating event network-changed:bbd097dd-ea19-4a4e-a3ed-ffc024cf517d for instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 on hv-cinder-81588 Oct 29 13:37:34.328796 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-78a61a82-24ed-417a-b0f8-5997cde836c0 req-cdb5c6a6-d9bb-447c-a440-7fdc5e691647 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046719 Oct 29 13:37:34.329592 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 432/843] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:34.471001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:34.478205 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-82b7b4b7-b946-4ecb-8769-5bca35206c26 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1361 microversion: 2.1 time: 0.561471 Oct 29 13:37:34.479093 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 412/844] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:33 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1361 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:35.289189 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-04f465fa-7ece-4b52-b0bf-664ae7e8cf78 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:35.290233 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-04f465fa-7ece-4b52-b0bf-664ae7e8cf78 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:35.297206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-04f465fa-7ece-4b52-b0bf-664ae7e8cf78 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:35.297917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-04f465fa-7ece-4b52-b0bf-664ae7e8cf78 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:35.298925 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-04f465fa-7ece-4b52-b0bf-664ae7e8cf78 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:35.299576 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-04f465fa-7ece-4b52-b0bf-664ae7e8cf78 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:35.367509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-04f465fa-7ece-4b52-b0bf-664ae7e8cf78 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.082381 Oct 29 13:37:35.371469 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 433/845] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:35 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:35.496795 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:35.497339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:35.509112 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:35.516114 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:35.517137 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:35.517766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:35.736096 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:35.743678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b244f756-8068-4194-a978-d055877d206f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1361 microversion: 2.1 time: 0.250636 Oct 29 13:37:35.744339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 413/846] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:35 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:36.379375 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0eaa609f-16d5-4074-afe9-297d891c5d4c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:36.380519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0eaa609f-16d5-4074-afe9-297d891c5d4c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:36.392036 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eaa609f-16d5-4074-afe9-297d891c5d4c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:36.392501 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eaa609f-16d5-4074-afe9-297d891c5d4c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:36.393275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eaa609f-16d5-4074-afe9-297d891c5d4c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:36.393699 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eaa609f-16d5-4074-afe9-297d891c5d4c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:36.477887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0eaa609f-16d5-4074-afe9-297d891c5d4c tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 14 microversion: 2.20 time: 0.102316 Oct 29 13:37:36.481990 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 434/847] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:36 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:36.762969 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:36.763717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:36.778850 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:36.780307 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:36.781158 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:36.782007 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:36.988144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:36.997309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-eb9ab3ec-41e0-41df-8bd7-905b41527ef5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1361 microversion: 2.1 time: 0.239509 Oct 29 13:37:37.007210 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 414/848] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:36 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:37.491584 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0215ee7b-4e1c-4621-86a5-93e2473b0bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:37.492597 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0215ee7b-4e1c-4621-86a5-93e2473b0bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:37.499700 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0215ee7b-4e1c-4621-86a5-93e2473b0bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:37.500294 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0215ee7b-4e1c-4621-86a5-93e2473b0bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:37.501073 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0215ee7b-4e1c-4621-86a5-93e2473b0bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:37.501506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0215ee7b-4e1c-4621-86a5-93e2473b0bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:37.584038 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0215ee7b-4e1c-4621-86a5-93e2473b0bbe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 10893 microversion: 2.20 time: 0.097304 Oct 29 13:37:37.587473 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 435/849] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:37 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 10893 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:38.015427 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:38.016041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:38.024730 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:38.025733 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:38.026815 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:38.027408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:38.222109 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:38.230850 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ec68e27a-817e-472d-b100-0d44a11b84b5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1361 microversion: 2.1 time: 0.219879 Oct 29 13:37:38.231438 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 415/850] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:38 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:38.596618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4103f1c3-4d2a-462b-afa8-a2621345b045 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:38.597713 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4103f1c3-4d2a-462b-afa8-a2621345b045 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:38.607916 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4103f1c3-4d2a-462b-afa8-a2621345b045 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:38.608357 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4103f1c3-4d2a-462b-afa8-a2621345b045 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:38.609142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4103f1c3-4d2a-462b-afa8-a2621345b045 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:38.614883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4103f1c3-4d2a-462b-afa8-a2621345b045 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:38.710719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4103f1c3-4d2a-462b-afa8-a2621345b045 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 15896 microversion: 2.20 time: 0.118678 Oct 29 13:37:38.714572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 436/851] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:38 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 15896 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:39.249121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:39.250378 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:39.258518 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:39.259076 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:39.260109 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:39.260643 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:39.407406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:39.416089 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8d98ac86-74de-405c-a180-702fe22f2cb2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1361 microversion: 2.1 time: 0.171334 Oct 29 13:37:39.416788 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 416/852] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:39 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:39.723065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9af3e316-7595-4efb-96d6-87d2933c5b6b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:39.724170 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9af3e316-7595-4efb-96d6-87d2933c5b6b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:39.734141 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9af3e316-7595-4efb-96d6-87d2933c5b6b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:39.742422 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9af3e316-7595-4efb-96d6-87d2933c5b6b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:39.746423 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9af3e316-7595-4efb-96d6-87d2933c5b6b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:39.746924 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9af3e316-7595-4efb-96d6-87d2933c5b6b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:39.850743 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9af3e316-7595-4efb-96d6-87d2933c5b6b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 18083 microversion: 2.20 time: 0.131784 Oct 29 13:37:39.853194 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 437/853] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:39 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 18083 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:39.921661 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-0ff46da8-3a4f-42ae-a96e-ad0d8ac2cdd1 req-6fc530a7-39b7-4447-8cbd-403209e3ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4", "name": "network-vif-plugged", "status": "completed", "tag": "bbd097dd-ea19-4a4e-a3ed-ffc024cf517d"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:39.923426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:39.923426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:37:39.936802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0ff46da8-3a4f-42ae-a96e-ad0d8ac2cdd1 req-6fc530a7-39b7-4447-8cbd-403209e3ce1f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:39.937305 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0ff46da8-3a4f-42ae-a96e-ad0d8ac2cdd1 req-6fc530a7-39b7-4447-8cbd-403209e3ce1f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:39.968127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-0ff46da8-3a4f-42ae-a96e-ad0d8ac2cdd1 req-6fc530a7-39b7-4447-8cbd-403209e3ce1f service nova] Creating event network-vif-plugged:bbd097dd-ea19-4a4e-a3ed-ffc024cf517d for instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 on hv-cinder-81588 Oct 29 13:37:39.981894 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-0ff46da8-3a4f-42ae-a96e-ad0d8ac2cdd1 req-6fc530a7-39b7-4447-8cbd-403209e3ce1f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064636 Oct 29 13:37:39.983013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 417/854] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:37:40.864380 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1da4d06e-8079-43b1-a230-e4b8addaaf3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:40.866203 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1da4d06e-8079-43b1-a230-e4b8addaaf3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:40.883082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1da4d06e-8079-43b1-a230-e4b8addaaf3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:40.883798 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1da4d06e-8079-43b1-a230-e4b8addaaf3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:40.891589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:40.892770 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:40.896070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1da4d06e-8079-43b1-a230-e4b8addaaf3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:40.898376 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1da4d06e-8079-43b1-a230-e4b8addaaf3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:40.902142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:40.902584 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:40.903365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:40.903796 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:41.017385 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1da4d06e-8079-43b1-a230-e4b8addaaf3e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 19342 microversion: 2.20 time: 0.157248 Oct 29 13:37:41.018490 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 418/855] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:40 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 19342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:41.149792 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:41.160882 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9b2121ba-118a-47c2-a327-3cce8532c2d1 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1361 microversion: 2.1 time: 0.728210 Oct 29 13:37:41.161517 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 438/856] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:40 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1361 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:42.029740 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-38c32833-057c-46bc-a0a7-6aeffdb4aa07 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:42.030778 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-38c32833-057c-46bc-a0a7-6aeffdb4aa07 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:42.071683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-38c32833-057c-46bc-a0a7-6aeffdb4aa07 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:42.072153 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-38c32833-057c-46bc-a0a7-6aeffdb4aa07 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:42.072964 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-38c32833-057c-46bc-a0a7-6aeffdb4aa07 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:42.073396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-38c32833-057c-46bc-a0a7-6aeffdb4aa07 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:42.180402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:42.181098 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:42.191509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:42.192339 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:42.193124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:42.202122 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:42.209894 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-38c32833-057c-46bc-a0a7-6aeffdb4aa07 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 21513 microversion: 2.20 time: 0.182027 Oct 29 13:37:42.210802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 419/857] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:42 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 21513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:42.440931 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:42.449205 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d65042d1-7520-4d30-9288-d0f59a45067c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1546 microversion: 2.1 time: 0.274955 Oct 29 13:37:42.453129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 439/858] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:42 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1546 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:42.471930 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-69d6ed99-ce00-4d35-9458-86baccbacc10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:42.472704 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-69d6ed99-ce00-4d35-9458-86baccbacc10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:42.482096 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69d6ed99-ce00-4d35-9458-86baccbacc10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:42.482583 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69d6ed99-ce00-4d35-9458-86baccbacc10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:42.483364 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69d6ed99-ce00-4d35-9458-86baccbacc10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:42.484254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-69d6ed99-ce00-4d35-9458-86baccbacc10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:42.595186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-69d6ed99-ce00-4d35-9458-86baccbacc10 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127000 Oct 29 13:37:42.597627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 420/859] 10.222.0.96 () {58 vars in 1274 bytes} [Fri Oct 29 13:37:42 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:43.221956 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-465c97c2-7313-4679-aa06-b2fd193175a4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:43.222922 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-465c97c2-7313-4679-aa06-b2fd193175a4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:43.234465 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-465c97c2-7313-4679-aa06-b2fd193175a4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:43.234917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-465c97c2-7313-4679-aa06-b2fd193175a4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:43.235704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-465c97c2-7313-4679-aa06-b2fd193175a4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:43.236138 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-465c97c2-7313-4679-aa06-b2fd193175a4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:43.334166 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-465c97c2-7313-4679-aa06-b2fd193175a4 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 22942 microversion: 2.20 time: 0.115643 Oct 29 13:37:43.337254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 440/860] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:43 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 22942 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:43.814609 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d160f78b-f97f-44c7-b858-478e8209ec25 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:43.815762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d160f78b-f97f-44c7-b858-478e8209ec25 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:43.820766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-ea8e44bd-6838-4957-912a-307e4a9a1a8e req-4ec39aae-a11e-4a3f-b86b-1cb132358a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4", "tag": "bbd097dd-ea19-4a4e-a3ed-ffc024cf517d"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:43.821934 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d160f78b-f97f-44c7-b858-478e8209ec25 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:43.822283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:43.822283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:37:43.822545 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d160f78b-f97f-44c7-b858-478e8209ec25 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:43.823152 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d160f78b-f97f-44c7-b858-478e8209ec25 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:43.823582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d160f78b-f97f-44c7-b858-478e8209ec25 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:43.831398 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-ea8e44bd-6838-4957-912a-307e4a9a1a8e req-4ec39aae-a11e-4a3f-b86b-1cb132358a84 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:43.832570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-ea8e44bd-6838-4957-912a-307e4a9a1a8e req-4ec39aae-a11e-4a3f-b86b-1cb132358a84 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:43.845515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-ea8e44bd-6838-4957-912a-307e4a9a1a8e req-4ec39aae-a11e-4a3f-b86b-1cb132358a84 service nova] Creating event network-changed:bbd097dd-ea19-4a4e-a3ed-ffc024cf517d for instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 on hv-cinder-81588 Oct 29 13:37:43.857088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-ea8e44bd-6838-4957-912a-307e4a9a1a8e req-4ec39aae-a11e-4a3f-b86b-1cb132358a84 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035694 Oct 29 13:37:43.857984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 441/861] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:37:43.911306 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d160f78b-f97f-44c7-b858-478e8209ec25 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.101175 Oct 29 13:37:43.912283 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 421/862] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:43 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:37:44.348592 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6692753d-9865-4c0d-9dea-45a7e3a3becc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:44.349596 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6692753d-9865-4c0d-9dea-45a7e3a3becc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:44.356865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6692753d-9865-4c0d-9dea-45a7e3a3becc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:44.357860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6692753d-9865-4c0d-9dea-45a7e3a3becc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:44.364860 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6692753d-9865-4c0d-9dea-45a7e3a3becc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:44.365332 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6692753d-9865-4c0d-9dea-45a7e3a3becc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:44.474208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6692753d-9865-4c0d-9dea-45a7e3a3becc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 23228 microversion: 2.20 time: 0.130446 Oct 29 13:37:44.475483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 442/863] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:44 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 23228 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:44.645856 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-814902343", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-383892962", "security_groups": [{"name": "tempest-secgroup-smoke-746354481"}], "networks": [{"uuid": "e8713ec6-2bfb-425a-831c-4c8b1797ee7d"}], "block_device_mapping_v2": [{"uuid": "e3bd669e-3c25-41c9-97e5-8c5fe64f99db", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:44.806869 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] validate_networks() for [('e8713ec6-2bfb-425a-831c-4c8b1797ee7d', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:37:44.924947 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5df4f79c-d82e-40e0-9ced-44170dd849cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:44.925992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5df4f79c-d82e-40e0-9ced-44170dd849cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:44.955449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5df4f79c-d82e-40e0-9ced-44170dd849cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:44.955980 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5df4f79c-d82e-40e0-9ced-44170dd849cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:44.956854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5df4f79c-d82e-40e0-9ced-44170dd849cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:44.960178 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5df4f79c-d82e-40e0-9ced-44170dd849cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:45.070682 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5df4f79c-d82e-40e0-9ced-44170dd849cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.151005 Oct 29 13:37:45.074355 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 443/864] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:44 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:37:45.418688 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:37:45.419161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:37:45.419565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:37:45.420539 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:37:45.420950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:37:45.431088 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:45.431322 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:45.432372 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:45.433442 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:45.459634 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Getting quotas for project 01041e00f28e4197a613ed2b47866c73. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:45.463922 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Getting quotas for user 2e9366dec6d04ecdb0574a2d2e812a51 and project 01041e00f28e4197a613ed2b47866c73. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:45.487175 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1caa9ea6-965f-4c8a-ba2a-625555c5cfe8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:45.488235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1caa9ea6-965f-4c8a-ba2a-625555c5cfe8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:45.499921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1caa9ea6-965f-4c8a-ba2a-625555c5cfe8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:45.500364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1caa9ea6-965f-4c8a-ba2a-625555c5cfe8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:45.501138 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1caa9ea6-965f-4c8a-ba2a-625555c5cfe8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:45.501565 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1caa9ea6-965f-4c8a-ba2a-625555c5cfe8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:45.543565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:37:45.546380 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3bd669e-3c25-41c9-97e5-8c5fe64f99db',volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:37:45.589635 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1caa9ea6-965f-4c8a-ba2a-625555c5cfe8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 24580 microversion: 2.20 time: 0.107235 Oct 29 13:37:45.593536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 444/865] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:45 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 24580 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:45.700403 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e7710bf5-e26f-4d30-a700-aea16917da8f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.058560 Oct 29 13:37:45.701364 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 422/866] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:37:44 2021] POST /compute/v2.1/servers => generated 405 bytes in 1060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:37:45.711783 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b6ea667e-79f2-4753-93a4-522b0668577c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:45.712476 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b6ea667e-79f2-4753-93a4-522b0668577c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:45.812266 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b6ea667e-79f2-4753-93a4-522b0668577c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:45.819575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b6ea667e-79f2-4753-93a4-522b0668577c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1087 microversion: 2.1 time: 0.111408 Oct 29 13:37:45.829849 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 445/867] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:45 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1087 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:46.081970 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-260521b3-e78b-44d2-b393-6e9378a371cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:46.083032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-260521b3-e78b-44d2-b393-6e9378a371cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:46.107066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-260521b3-e78b-44d2-b393-6e9378a371cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:46.108263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-260521b3-e78b-44d2-b393-6e9378a371cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:46.111675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-260521b3-e78b-44d2-b393-6e9378a371cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:46.112451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-260521b3-e78b-44d2-b393-6e9378a371cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:46.189555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-260521b3-e78b-44d2-b393-6e9378a371cc tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.111437 Oct 29 13:37:46.195103 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 423/868] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:46 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:37:46.605172 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f4b9a3bc-fab8-49f8-b6a3-229f2ca1300e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:46.607679 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f4b9a3bc-fab8-49f8-b6a3-229f2ca1300e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:46.615595 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4b9a3bc-fab8-49f8-b6a3-229f2ca1300e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:46.615952 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4b9a3bc-fab8-49f8-b6a3-229f2ca1300e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:46.617120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4b9a3bc-fab8-49f8-b6a3-229f2ca1300e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:46.617747 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f4b9a3bc-fab8-49f8-b6a3-229f2ca1300e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:46.757910 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f4b9a3bc-fab8-49f8-b6a3-229f2ca1300e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 25922 microversion: 2.20 time: 0.156568 Oct 29 13:37:46.758574 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 446/869] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:46 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 25922 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:46.836702 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:46.837403 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:46.852703 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:46.860482 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:46.861545 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:46.862172 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:46.957994 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:46.965619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cc09fb3d-ae03-4f01-9d25-fc5ad64983f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1185 microversion: 2.1 time: 0.132882 Oct 29 13:37:46.969128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 424/870] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:46 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:47.201895 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9d6f347f-60f2-4f07-8a6b-ea3a2ef52219 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:47.203096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9d6f347f-60f2-4f07-8a6b-ea3a2ef52219 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:47.220581 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9d6f347f-60f2-4f07-8a6b-ea3a2ef52219 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:47.221038 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9d6f347f-60f2-4f07-8a6b-ea3a2ef52219 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:47.221967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9d6f347f-60f2-4f07-8a6b-ea3a2ef52219 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:47.222402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9d6f347f-60f2-4f07-8a6b-ea3a2ef52219 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:47.354699 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9d6f347f-60f2-4f07-8a6b-ea3a2ef52219 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.156509 Oct 29 13:37:47.358495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 447/871] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:47 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:37:47.988149 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:47.990596 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:47.995347 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f8685617-eadf-4faa-b49e-d02b5d649147 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:47.996284 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f8685617-eadf-4faa-b49e-d02b5d649147 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:48.006974 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:48.008126 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8685617-eadf-4faa-b49e-d02b5d649147 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:48.008585 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8685617-eadf-4faa-b49e-d02b5d649147 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:48.009873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8685617-eadf-4faa-b49e-d02b5d649147 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:48.010314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f8685617-eadf-4faa-b49e-d02b5d649147 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:48.011392 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:48.014666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:48.015593 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:48.120082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f8685617-eadf-4faa-b49e-d02b5d649147 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 27210 microversion: 2.20 time: 0.353239 Oct 29 13:37:48.125415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 425/872] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:47 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 27210 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:48.369370 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0ef462f6-055f-4479-846f-1aed6a06c4b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:48.377236 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0ef462f6-055f-4479-846f-1aed6a06c4b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:48.386538 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:48.395576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ef462f6-055f-4479-846f-1aed6a06c4b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:48.396344 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ef462f6-055f-4479-846f-1aed6a06c4b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:48.397551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ef462f6-055f-4479-846f-1aed6a06c4b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:48.397908 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7f899761-8c47-4add-ac85-9aec7b8f965c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1270 microversion: 2.1 time: 0.416292 Oct 29 13:37:48.399066 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 448/873] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:47 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1270 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:48.399708 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0ef462f6-055f-4479-846f-1aed6a06c4b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:48.477071 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0ef462f6-055f-4479-846f-1aed6a06c4b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.113521 Oct 29 13:37:48.483000 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 426/874] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:48 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:37:49.139194 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8993fd68-20ce-4757-b29e-401a2ae64002 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:49.140225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8993fd68-20ce-4757-b29e-401a2ae64002 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:49.174832 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8993fd68-20ce-4757-b29e-401a2ae64002 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:49.180556 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8993fd68-20ce-4757-b29e-401a2ae64002 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:49.196467 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8993fd68-20ce-4757-b29e-401a2ae64002 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:49.196969 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8993fd68-20ce-4757-b29e-401a2ae64002 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:49.243402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-0e750c76-ce33-438e-82cc-ccbcdf83e5bc req-084aed2c-b9f4-4522-a3a3-76f893a07e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1", "tag": "1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:49.245122 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:37:49.245122 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:37:49.266571 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0e750c76-ce33-438e-82cc-ccbcdf83e5bc req-084aed2c-b9f4-4522-a3a3-76f893a07e67 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:49.267012 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-0e750c76-ce33-438e-82cc-ccbcdf83e5bc req-084aed2c-b9f4-4522-a3a3-76f893a07e67 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:49.300790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-0e750c76-ce33-438e-82cc-ccbcdf83e5bc req-084aed2c-b9f4-4522-a3a3-76f893a07e67 service nova] Creating event network-changed:1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2 for instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 on hv-cinder-81588 Oct 29 13:37:49.306084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-0e750c76-ce33-438e-82cc-ccbcdf83e5bc req-084aed2c-b9f4-4522-a3a3-76f893a07e67 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157373 Oct 29 13:37:49.309375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 427/875] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:37:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:37:49.329604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8993fd68-20ce-4757-b29e-401a2ae64002 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 27791 microversion: 2.20 time: 0.196200 Oct 29 13:37:49.333972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 449/876] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:49 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 27791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:49.415597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:49.416401 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:49.425608 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:49.426790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:49.427757 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:49.428352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:49.492966 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d2cc3b0b-9ef4-400d-a379-76c50030cffa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:49.494138 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d2cc3b0b-9ef4-400d-a379-76c50030cffa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:49.504198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2cc3b0b-9ef4-400d-a379-76c50030cffa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:49.504874 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2cc3b0b-9ef4-400d-a379-76c50030cffa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:49.507694 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2cc3b0b-9ef4-400d-a379-76c50030cffa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:49.508357 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2cc3b0b-9ef4-400d-a379-76c50030cffa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:49.580764 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:49.589197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-028cc8a7-9c4f-4f77-8bdc-ebfed5c21782 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.177548 Oct 29 13:37:49.601041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 428/877] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:49 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:49.601257 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d2cc3b0b-9ef4-400d-a379-76c50030cffa tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.105739 Oct 29 13:37:49.604982 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 450/878] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:49 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:37:50.341055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-60c6dff5-2fda-4d1b-9f5c-b7d6c92e9030 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:50.342898 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-60c6dff5-2fda-4d1b-9f5c-b7d6c92e9030 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:50.355460 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c6dff5-2fda-4d1b-9f5c-b7d6c92e9030 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:50.355893 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c6dff5-2fda-4d1b-9f5c-b7d6c92e9030 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:50.356674 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c6dff5-2fda-4d1b-9f5c-b7d6c92e9030 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:50.357139 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c6dff5-2fda-4d1b-9f5c-b7d6c92e9030 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:50.432589 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-60c6dff5-2fda-4d1b-9f5c-b7d6c92e9030 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 28220 microversion: 2.20 time: 0.095076 Oct 29 13:37:50.433965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 429/879] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:50 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 28220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:37:50.608670 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:50.609604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:50.613594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a15dc6f8-2acc-4a07-8900-0e09d00b8a34 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:50.614637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a15dc6f8-2acc-4a07-8900-0e09d00b8a34 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:50.616771 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:50.617483 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:50.618683 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:50.619385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:50.621013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a15dc6f8-2acc-4a07-8900-0e09d00b8a34 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:50.621456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a15dc6f8-2acc-4a07-8900-0e09d00b8a34 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:50.622272 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a15dc6f8-2acc-4a07-8900-0e09d00b8a34 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:50.623197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a15dc6f8-2acc-4a07-8900-0e09d00b8a34 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:50.731924 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a15dc6f8-2acc-4a07-8900-0e09d00b8a34 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.122697 Oct 29 13:37:50.732617 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 430/880] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:50 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:37:50.961490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:50.969686 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a157844f-470f-4459-990e-4216a52ea150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.365334 Oct 29 13:37:50.970391 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 451/881] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:50 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:51.446259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4564fa63-80cb-4ef5-9091-4cb6189656cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:51.447352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4564fa63-80cb-4ef5-9091-4cb6189656cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:51.453644 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4564fa63-80cb-4ef5-9091-4cb6189656cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:51.454185 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4564fa63-80cb-4ef5-9091-4cb6189656cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:51.455031 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4564fa63-80cb-4ef5-9091-4cb6189656cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:51.455641 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4564fa63-80cb-4ef5-9091-4cb6189656cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:51.523735 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4564fa63-80cb-4ef5-9091-4cb6189656cb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 28220 microversion: 2.20 time: 0.081842 Oct 29 13:37:51.524379 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 431/882] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:51 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 28220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:51.747595 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ff85a97f-6145-4012-a746-19d885cea5bf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:51.749182 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ff85a97f-6145-4012-a746-19d885cea5bf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:51.756382 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff85a97f-6145-4012-a746-19d885cea5bf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:51.756963 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff85a97f-6145-4012-a746-19d885cea5bf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:51.757861 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff85a97f-6145-4012-a746-19d885cea5bf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:51.758644 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ff85a97f-6145-4012-a746-19d885cea5bf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:51.827688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ff85a97f-6145-4012-a746-19d885cea5bf tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.083662 Oct 29 13:37:51.829004 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 452/883] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:51 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:37:51.988041 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:51.988743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:51.995165 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:51.995618 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:51.996382 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:51.996811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:52.129862 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:52.137415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e30dadb6-9655-4821-814f-8954eed11fda tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.153761 Oct 29 13:37:52.138199 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 432/884] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:51 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:52.536277 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a920a725-6eb0-45cf-ae0f-54d3a9aac3a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:52.537154 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a920a725-6eb0-45cf-ae0f-54d3a9aac3a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:52.545817 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a920a725-6eb0-45cf-ae0f-54d3a9aac3a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:52.545817 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a920a725-6eb0-45cf-ae0f-54d3a9aac3a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:52.547547 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a920a725-6eb0-45cf-ae0f-54d3a9aac3a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:52.547547 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a920a725-6eb0-45cf-ae0f-54d3a9aac3a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:52.632076 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a920a725-6eb0-45cf-ae0f-54d3a9aac3a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 28510 microversion: 2.20 time: 0.099775 Oct 29 13:37:52.633109 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 453/885] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:52 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 28510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:52.839005 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-40bdd7ac-a8c7-40d7-b688-0098788f83f6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:52.840161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-40bdd7ac-a8c7-40d7-b688-0098788f83f6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:52.849347 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40bdd7ac-a8c7-40d7-b688-0098788f83f6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:52.849812 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40bdd7ac-a8c7-40d7-b688-0098788f83f6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:52.850658 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40bdd7ac-a8c7-40d7-b688-0098788f83f6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:52.851084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-40bdd7ac-a8c7-40d7-b688-0098788f83f6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:52.919159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-40bdd7ac-a8c7-40d7-b688-0098788f83f6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.083550 Oct 29 13:37:52.923130 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 433/886] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:52 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:37:53.155725 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:53.156431 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:53.163566 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:53.164012 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:53.164809 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:53.165241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:53.310071 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:53.317436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e8990218-8b21-4454-b784-5de864e2ba1a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.166424 Oct 29 13:37:53.318034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 454/887] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:53 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:53.645436 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e61ad9ae-15e9-46d3-bc1e-177d9e18b3d3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:53.646817 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e61ad9ae-15e9-46d3-bc1e-177d9e18b3d3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:53.653028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e61ad9ae-15e9-46d3-bc1e-177d9e18b3d3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:53.653465 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e61ad9ae-15e9-46d3-bc1e-177d9e18b3d3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:53.654290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e61ad9ae-15e9-46d3-bc1e-177d9e18b3d3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:53.655007 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e61ad9ae-15e9-46d3-bc1e-177d9e18b3d3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:53.739917 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e61ad9ae-15e9-46d3-bc1e-177d9e18b3d3 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 28678 microversion: 2.20 time: 0.098283 Oct 29 13:37:53.740560 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 434/888] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:53 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 28678 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:37:53.836364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-34ea637e-a287-445d-a0a2-7056467e3a88 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Action: 'create', calling method: .version_select at 0x7f548008b9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-373014422"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:53.852975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-34ea637e-a287-445d-a0a2-7056467e3a88 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Getting quotas for project 0ec7253bb7c24dabb6c7b2841791c547. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:53.856617 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-34ea637e-a287-445d-a0a2-7056467e3a88 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Getting quotas for user 9d0e2de38d904112802ef3d3c04c5c44 and project 0ec7253bb7c24dabb6c7b2841791c547. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:53.930410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-22019702-c7fb-485a-9cf2-6fcfed821881 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:53.931402 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-22019702-c7fb-485a-9cf2-6fcfed821881 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:53.938428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22019702-c7fb-485a-9cf2-6fcfed821881 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:53.938881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22019702-c7fb-485a-9cf2-6fcfed821881 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:53.939648 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22019702-c7fb-485a-9cf2-6fcfed821881 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:53.940085 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-22019702-c7fb-485a-9cf2-6fcfed821881 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:53.996005 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-22019702-c7fb-485a-9cf2-6fcfed821881 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 14 microversion: 2.1 time: 0.069545 Oct 29 13:37:53.996586 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 435/889] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:53 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:37:54.269514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-34ea637e-a287-445d-a0a2-7056467e3a88 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Getting quotas for project 0ec7253bb7c24dabb6c7b2841791c547. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:54.272988 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-34ea637e-a287-445d-a0a2-7056467e3a88 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Getting quotas for user 9d0e2de38d904112802ef3d3c04c5c44 and project 0ec7253bb7c24dabb6c7b2841791c547. Resources: {'key_pairs'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:54.285647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-34ea637e-a287-445d-a0a2-7056467e3a88 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.452902 Oct 29 13:37:54.286253 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 455/890] 10.222.0.96 () {60 vars in 1157 bytes} [Fri Oct 29 13:37:53 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:54.334078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:54.334688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:54.334806 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1984092318", "imageRef": "5b61614b-ac84-4ce0-8ce1-e46971d78ef3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-373014422", "networks": [{"uuid": "fcecba9e-4220-4154-9f1a-9dc9f13e1f11"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:54.340592 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:54.341039 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:54.342357 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:54.342792 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:54.386655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] validate_networks() for [('fcecba9e-4220-4154-9f1a-9dc9f13e1f11', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:37:54.463722 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:54.471799 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ba4813f7-bd86-41b9-a3f5-f356f5eef22c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.141319 Oct 29 13:37:54.472366 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 456/891] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:54 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:54.738837 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:37:54.739255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:37:54.739721 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:37:54.740125 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:37:54.740529 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:37:54.749278 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:54.750026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:54.750853 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:54.751282 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:54.751879 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e9fc68d0-7d06-4f8b-b459-df4f3954782e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:54.752779 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e9fc68d0-7d06-4f8b-b459-df4f3954782e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:54.758504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9fc68d0-7d06-4f8b-b459-df4f3954782e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:54.758951 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9fc68d0-7d06-4f8b-b459-df4f3954782e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:54.759712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9fc68d0-7d06-4f8b-b459-df4f3954782e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:54.760144 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9fc68d0-7d06-4f8b-b459-df4f3954782e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:54.767624 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Getting quotas for project 0ec7253bb7c24dabb6c7b2841791c547. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:37:54.771480 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Getting quotas for user 9d0e2de38d904112802ef3d3c04c5c44 and project 0ec7253bb7c24dabb6c7b2841791c547. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:37:54.783555 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:37:54.785945 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5b61614b-ac84-4ce0-8ce1-e46971d78ef3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:37:54.821403 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e9fc68d0-7d06-4f8b-b459-df4f3954782e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 28678 microversion: 2.20 time: 0.073359 Oct 29 13:37:54.825407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 457/892] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:54 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 28678 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:37:54.828291 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-aa47bdd5-2d54-4590-ac0a-ddf7a3483a08 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497945 Oct 29 13:37:54.828932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 436/893] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:37:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 13:37:54.838870 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-78e99eb1-5734-4114-bbe3-c10af0513e1c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:54.839562 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-78e99eb1-5734-4114-bbe3-c10af0513e1c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:54.890896 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-78e99eb1-5734-4114-bbe3-c10af0513e1c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:54.897245 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-78e99eb1-5734-4114-bbe3-c10af0513e1c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1258 microversion: 2.1 time: 0.062200 Oct 29 13:37:54.897826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 458/894] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:54 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1258 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:55.006899 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-040d7cff-6b82-4ded-9464-a0e718d06a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:55.007914 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-040d7cff-6b82-4ded-9464-a0e718d06a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:55.014579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-040d7cff-6b82-4ded-9464-a0e718d06a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.015101 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-040d7cff-6b82-4ded-9464-a0e718d06a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:55.016046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-040d7cff-6b82-4ded-9464-a0e718d06a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.016574 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-040d7cff-6b82-4ded-9464-a0e718d06a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:55.087882 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-040d7cff-6b82-4ded-9464-a0e718d06a46 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 103 microversion: 2.1 time: 0.084540 Oct 29 13:37:55.091201 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 437/895] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:55 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 103 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:37:55.488350 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:55.489061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:55.495080 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.495520 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:55.496273 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.496732 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:55.614275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:55.621524 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-39d0f08c-0e8c-45e9-a599-d8169754f045 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.136830 Oct 29 13:37:55.626005 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 459/896] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:55 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:55.836232 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-feeeb4b1-7592-411b-a9c9-15895e3f70e5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:55.837884 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-feeeb4b1-7592-411b-a9c9-15895e3f70e5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:55.845373 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feeeb4b1-7592-411b-a9c9-15895e3f70e5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.846186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feeeb4b1-7592-411b-a9c9-15895e3f70e5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:55.847208 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feeeb4b1-7592-411b-a9c9-15895e3f70e5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.847890 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-feeeb4b1-7592-411b-a9c9-15895e3f70e5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:55.915992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:55.916766 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:55.927248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-feeeb4b1-7592-411b-a9c9-15895e3f70e5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 28678 microversion: 2.20 time: 0.097256 Oct 29 13:37:55.927926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 438/897] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:55 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 28678 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:37:55.928728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.929248 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:55.930050 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:55.930474 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:56.021694 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:56.029729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9f54ba66-1d87-434f-b772-64c28f9fce7b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1328 microversion: 2.1 time: 0.117910 Oct 29 13:37:56.030513 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 460/898] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:55 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1328 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:56.099132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d9794649-0191-4028-8210-c5136edf490d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:56.100127 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d9794649-0191-4028-8210-c5136edf490d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:56.108830 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9794649-0191-4028-8210-c5136edf490d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:56.109303 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9794649-0191-4028-8210-c5136edf490d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:56.110190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9794649-0191-4028-8210-c5136edf490d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:56.110636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d9794649-0191-4028-8210-c5136edf490d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:56.211819 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d9794649-0191-4028-8210-c5136edf490d tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 10893 microversion: 2.1 time: 0.116412 Oct 29 13:37:56.217993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 439/899] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:56 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 10893 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:37:56.639682 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:56.641060 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:56.647815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:56.648599 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:56.649643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:56.650329 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:56.784219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:56.791991 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-46b8c92b-12da-4463-9be8-997aeae459bf tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.156590 Oct 29 13:37:56.792598 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 461/900] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:56 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:37:56.939768 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-386e7b07-b456-422c-9c4b-8b4ebcd702fe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:56.940876 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-386e7b07-b456-422c-9c4b-8b4ebcd702fe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:56.948554 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-386e7b07-b456-422c-9c4b-8b4ebcd702fe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:56.948997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-386e7b07-b456-422c-9c4b-8b4ebcd702fe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:56.949765 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-386e7b07-b456-422c-9c4b-8b4ebcd702fe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:56.950224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-386e7b07-b456-422c-9c4b-8b4ebcd702fe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:57.046744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:37:57.047347 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:57.053390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:57.053863 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:57.054632 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:57.055061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:57.174632 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:37:57.181841 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cf2b5fa5-a820-4e9e-b701-a2a0526d31d1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1358 microversion: 2.1 time: 0.138915 Oct 29 13:37:57.182430 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 462/901] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:37:57 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:37:57.225365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7aaec351-a122-4184-be8e-96b98f1dc0b9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:37:57.226246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7aaec351-a122-4184-be8e-96b98f1dc0b9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:37:57.232103 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7aaec351-a122-4184-be8e-96b98f1dc0b9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:57.232552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7aaec351-a122-4184-be8e-96b98f1dc0b9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:37:57.233318 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7aaec351-a122-4184-be8e-96b98f1dc0b9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:37:57.233748 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7aaec351-a122-4184-be8e-96b98f1dc0b9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:08.161112 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-386e7b07-b456-422c-9c4b-8b4ebcd702fe tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 38229 microversion: 2.20 time: 11.225861 Oct 29 13:38:08.165363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 440/902] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:37:56 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 38229 bytes in 11228 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:38:08.167855 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:08.171332 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:08.178202 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:08.179035 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:08.179417 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:08.179840 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:08.179976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7aaec351-a122-4184-be8e-96b98f1dc0b9 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28186 microversion: 2.1 time: 10.958160 Oct 29 13:38:08.184098 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 463/903] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:37:57 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28186 bytes in 10961 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:38:08.253313 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-4be5f245-05b8-45d7-b528-9b5feaee5392 req-a8047f80-c274-468e-bea5-4ebed1efc65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1", "name": "network-vif-plugged", "status": "completed", "tag": "1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:08.255160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:08.255160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:38:08.262551 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-4be5f245-05b8-45d7-b528-9b5feaee5392 req-a8047f80-c274-468e-bea5-4ebed1efc65e service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:08.262994 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-4be5f245-05b8-45d7-b528-9b5feaee5392 req-a8047f80-c274-468e-bea5-4ebed1efc65e service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:08.275506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-4be5f245-05b8-45d7-b528-9b5feaee5392 req-a8047f80-c274-468e-bea5-4ebed1efc65e service nova] Creating event network-vif-plugged:1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2 for instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 on hv-cinder-81588 Oct 29 13:38:08.281591 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-4be5f245-05b8-45d7-b528-9b5feaee5392 req-a8047f80-c274-468e-bea5-4ebed1efc65e service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098490 Oct 29 13:38:08.282438 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 464/904] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:08.287297 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:08.287983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:08.294437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:08.294877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:08.296178 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:08.296614 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:08.315674 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:08.326287 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9ced7dbd-d3f9-4a8d-9a6d-ad5185c2866e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.162931 Oct 29 13:38:08.327276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 441/905] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:08 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:08.495684 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:08.503452 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a509292f-08b1-499d-82a2-bfc822d0d058 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1358 microversion: 2.1 time: 0.219924 Oct 29 13:38:08.504345 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 465/906] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:08 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:08.800233 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-80f9be0f-f6fa-4a50-b6c8-98ecb690afa2 req-62969534-060b-430f-8068-ecc89fb7f00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471017e8-2ba0-4199-9c0a-732ae35252f4", "tag": "a6f1c1d1-b296-47fe-861a-d306e40696a7"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:08.802197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:08.802197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:38:08.811640 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-80f9be0f-f6fa-4a50-b6c8-98ecb690afa2 req-62969534-060b-430f-8068-ecc89fb7f00f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:08.812458 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-80f9be0f-f6fa-4a50-b6c8-98ecb690afa2 req-62969534-060b-430f-8068-ecc89fb7f00f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:08.827474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-80f9be0f-f6fa-4a50-b6c8-98ecb690afa2 req-62969534-060b-430f-8068-ecc89fb7f00f service nova] Creating event network-changed:a6f1c1d1-b296-47fe-861a-d306e40696a7 for instance 471017e8-2ba0-4199-9c0a-732ae35252f4 on hv-cinder-81588 Oct 29 13:38:08.832818 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-80f9be0f-f6fa-4a50-b6c8-98ecb690afa2 req-62969534-060b-430f-8068-ecc89fb7f00f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037074 Oct 29 13:38:08.833740 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 442/907] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 29 13:38:09.172920 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2d12ae9c-3e69-4111-a3b4-2b52ca22d896 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:09.173983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2d12ae9c-3e69-4111-a3b4-2b52ca22d896 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:09.179623 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d12ae9c-3e69-4111-a3b4-2b52ca22d896 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.180065 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d12ae9c-3e69-4111-a3b4-2b52ca22d896 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.180826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d12ae9c-3e69-4111-a3b4-2b52ca22d896 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.181249 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2d12ae9c-3e69-4111-a3b4-2b52ca22d896 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.192486 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c3cc80a7-f8ff-4be6-a43f-ffca938c80ca tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:09.194102 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c3cc80a7-f8ff-4be6-a43f-ffca938c80ca tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:09.200268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3cc80a7-f8ff-4be6-a43f-ffca938c80ca tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.200647 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3cc80a7-f8ff-4be6-a43f-ffca938c80ca tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.201410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3cc80a7-f8ff-4be6-a43f-ffca938c80ca tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.201945 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c3cc80a7-f8ff-4be6-a43f-ffca938c80ca tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.248676 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2d12ae9c-3e69-4111-a3b4-2b52ca22d896 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 38229 microversion: 2.20 time: 0.079211 Oct 29 13:38:09.250410 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 466/908] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:38:09 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 38229 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:38:09.276894 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c3cc80a7-f8ff-4be6-a43f-ffca938c80ca tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28186 microversion: 2.1 time: 0.088034 Oct 29 13:38:09.277793 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 443/909] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:09 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28186 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:09.343586 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:09.344277 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:09.350667 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.351103 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.351857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.352287 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.520913 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:09.521715 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:09.528196 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.528720 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.529491 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:09.529953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:09.542047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:09.550271 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cfce51b1-ff85-42e8-b27a-c65833d5c9f1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1258 microversion: 2.1 time: 0.210578 Oct 29 13:38:09.550834 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 467/910] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:09 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1258 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:09.656408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:09.663711 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-14bef0c3-c236-4657-bacd-f941f46b9179 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1358 microversion: 2.1 time: 0.146843 Oct 29 13:38:09.664271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 444/911] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:09 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:10.260542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-454c7457-e19a-444b-9805-1099f64aca42 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:10.261503 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-454c7457-e19a-444b-9805-1099f64aca42 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:10.267862 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-454c7457-e19a-444b-9805-1099f64aca42 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.268308 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-454c7457-e19a-444b-9805-1099f64aca42 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.269066 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-454c7457-e19a-444b-9805-1099f64aca42 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.269496 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-454c7457-e19a-444b-9805-1099f64aca42 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.288293 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ad6bbf3d-8fe0-4a6f-8657-9c207a60a044 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:10.289193 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ad6bbf3d-8fe0-4a6f-8657-9c207a60a044 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:10.294734 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad6bbf3d-8fe0-4a6f-8657-9c207a60a044 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.295176 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad6bbf3d-8fe0-4a6f-8657-9c207a60a044 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.296015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad6bbf3d-8fe0-4a6f-8657-9c207a60a044 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.296437 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad6bbf3d-8fe0-4a6f-8657-9c207a60a044 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.354856 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-454c7457-e19a-444b-9805-1099f64aca42 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 200 len: 38370 microversion: 2.20 time: 0.097861 Oct 29 13:38:10.355491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 468/912] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:38:10 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 38370 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:38:10.365504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8ade26ea-86cb-46e1-a58d-7fbf3aa716a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:10.366091 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8ade26ea-86cb-46e1-a58d-7fbf3aa716a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:10.372353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ade26ea-86cb-46e1-a58d-7fbf3aa716a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.372787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ade26ea-86cb-46e1-a58d-7fbf3aa716a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.373535 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ade26ea-86cb-46e1-a58d-7fbf3aa716a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.374052 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8ade26ea-86cb-46e1-a58d-7fbf3aa716a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.385488 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ad6bbf3d-8fe0-4a6f-8657-9c207a60a044 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28314 microversion: 2.1 time: 0.100635 Oct 29 13:38:10.387132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 445/913] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:10 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28314 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:38:10.397345 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8ade26ea-86cb-46e1-a58d-7fbf3aa716a9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/ips" status: 200 len: 152 microversion: 2.20 time: 0.035585 Oct 29 13:38:10.397976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 469/914] 10.222.0.96 () {60 vars in 1288 bytes} [Fri Oct 29 13:38:10 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:38:10.567128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:10.567822 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:10.574203 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.574647 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.575417 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.575844 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.680475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:10.681217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:10.688291 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.689009 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.689866 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.690295 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.720262 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:10.728046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9aba6fee-a22b-4446-806e-1deef3660445 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1442 microversion: 2.1 time: 0.164833 Oct 29 13:38:10.728628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 446/915] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:10 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:38:10.743905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:10.744510 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:10.750998 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.751444 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.752214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:10.752647 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:10.810839 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:10.818573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6ef0f3b3-412d-4a56-a49b-4df003e742fc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1358 microversion: 2.1 time: 0.141909 Oct 29 13:38:10.820727 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 470/916] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:10 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:38:10.869915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:10.878383 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-622513e0-1ab8-4f08-91ff-6174f21d51b6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1442 microversion: 2.1 time: 0.137957 Oct 29 13:38:10.878951 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 447/917] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:10 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1442 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:38:11.397683 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8917c7b5-ffb8-4018-bcde-c10154cdc8da tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:11.398622 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8917c7b5-ffb8-4018-bcde-c10154cdc8da tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:11.404753 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8917c7b5-ffb8-4018-bcde-c10154cdc8da tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:11.405717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8917c7b5-ffb8-4018-bcde-c10154cdc8da tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:11.406506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8917c7b5-ffb8-4018-bcde-c10154cdc8da tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:11.406938 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8917c7b5-ffb8-4018-bcde-c10154cdc8da tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:11.485663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8917c7b5-ffb8-4018-bcde-c10154cdc8da tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28477 microversion: 2.1 time: 0.091522 Oct 29 13:38:11.486572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 471/918] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:11 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28477 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:11.835707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:11.836542 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:11.843486 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:11.843924 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:11.844691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:11.845120 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:12.025200 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:12.033250 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-48c3b08d-5e1d-424d-b4f6-c3d0553d78da tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1358 microversion: 2.1 time: 0.201374 Oct 29 13:38:12.033937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 448/919] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:11 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:12.498317 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-36942c72-fa61-4be9-904a-a578ffd359e6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:12.500188 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-36942c72-fa61-4be9-904a-a578ffd359e6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:12.508353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-36942c72-fa61-4be9-904a-a578ffd359e6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:12.508704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-36942c72-fa61-4be9-904a-a578ffd359e6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:12.509525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-36942c72-fa61-4be9-904a-a578ffd359e6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:12.509991 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-36942c72-fa61-4be9-904a-a578ffd359e6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:12.555993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:12.556524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:12.563950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:12.564395 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:12.565300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:12.565733 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:12.589725 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lazy-loading 'flavor' on Instance uuid b9c9065a-62c0-4f58-82af-bd44e7a1ac45 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:38:12.614615 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-36942c72-fa61-4be9-904a-a578ffd359e6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28645 microversion: 2.1 time: 0.120051 Oct 29 13:38:12.615320 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 472/920] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:12 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28645 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:12.692128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-7fb20c75-4cd9-4e32-84d6-59815f5985bb req-2b7a8f07-25e3-4dd6-819b-19e1903e059d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1", "tag": "1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:12.693848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:12.693848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:38:12.701482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-7fb20c75-4cd9-4e32-84d6-59815f5985bb req-2b7a8f07-25e3-4dd6-819b-19e1903e059d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:12.702051 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-7fb20c75-4cd9-4e32-84d6-59815f5985bb req-2b7a8f07-25e3-4dd6-819b-19e1903e059d service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:12.712826 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-7fb20c75-4cd9-4e32-84d6-59815f5985bb req-2b7a8f07-25e3-4dd6-819b-19e1903e059d service nova] Creating event network-changed:1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2 for instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 on hv-cinder-81588 Oct 29 13:38:12.719084 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-7fb20c75-4cd9-4e32-84d6-59815f5985bb req-2b7a8f07-25e3-4dd6-819b-19e1903e059d service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101562 Oct 29 13:38:12.719564 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 473/921] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:12.867611 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4aea0b01-f2b8-48bc-83f2-d502f1c6cda5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 202 len: 0 microversion: 2.20 time: 0.315330 Oct 29 13:38:12.868829 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 449/922] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:38:12 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:38:12.882702 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:12.883409 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:12.889664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:12.891821 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:12.894829 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:12.895657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:13.052433 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:13.053419 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:13.059612 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:13.060061 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:13.060833 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:13.061428 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:13.092910 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:13.100889 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:13.102697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:13.104056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-97223823-9c1d-41f2-825d-4dd717d44532 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.231153 Oct 29 13:38:13.104805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 474/923] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:12 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:13.195021 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:13.203478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4c594c1b-debb-4c87-aa8c-991b4c6bfa8d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1358 microversion: 2.1 time: 0.155712 Oct 29 13:38:13.208474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 450/924] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:13 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:38:13.626857 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5fa6a9a9-f7d9-4469-a26c-3b79d116011b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:13.627675 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5fa6a9a9-f7d9-4469-a26c-3b79d116011b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:13.634218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5fa6a9a9-f7d9-4469-a26c-3b79d116011b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:13.634668 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5fa6a9a9-f7d9-4469-a26c-3b79d116011b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:13.635442 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5fa6a9a9-f7d9-4469-a26c-3b79d116011b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:13.635883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5fa6a9a9-f7d9-4469-a26c-3b79d116011b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:13.700240 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5fa6a9a9-f7d9-4469-a26c-3b79d116011b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28645 microversion: 2.1 time: 0.078095 Oct 29 13:38:13.700887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 475/925] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:13 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28645 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:14.042604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-9cac44c2-e6f6-4b48-89db-f40db46507d5 req-720edacf-f273-4695-bbda-4a66e990595a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471017e8-2ba0-4199-9c0a-732ae35252f4", "name": "network-vif-plugged", "status": "completed", "tag": "a6f1c1d1-b296-47fe-861a-d306e40696a7"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:14.044160 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:14.044160 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:38:14.053435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-9cac44c2-e6f6-4b48-89db-f40db46507d5 req-720edacf-f273-4695-bbda-4a66e990595a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:14.053908 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-9cac44c2-e6f6-4b48-89db-f40db46507d5 req-720edacf-f273-4695-bbda-4a66e990595a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:14.065955 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-9cac44c2-e6f6-4b48-89db-f40db46507d5 req-720edacf-f273-4695-bbda-4a66e990595a service nova] Creating event network-vif-plugged:a6f1c1d1-b296-47fe-861a-d306e40696a7 for instance 471017e8-2ba0-4199-9c0a-732ae35252f4 on hv-cinder-81588 Oct 29 13:38:14.071012 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-9cac44c2-e6f6-4b48-89db-f40db46507d5 req-720edacf-f273-4695-bbda-4a66e990595a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Oct 29 13:38:14.071966 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 451/926] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:14.125717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:14.126515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:14.133727 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:14.134133 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:14.134911 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:14.135749 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:14.220145 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:14.220842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:14.226844 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:14.227286 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:14.228051 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:14.228511 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:14.302014 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:14.310488 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:14.312693 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:14.314134 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-557d03bd-da27-461a-81e5-77aa6c490279 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.194162 Oct 29 13:38:14.314877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 476/927] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:14 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:14.606520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:14.614493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e32fc28f-fd80-4e14-92de-2da64cd53306 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1358 microversion: 2.1 time: 0.398759 Oct 29 13:38:14.615058 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 452/928] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:14 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1358 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:14.712075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c1088e86-f257-44da-b5e5-9de5bd9e1dd4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:14.712970 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c1088e86-f257-44da-b5e5-9de5bd9e1dd4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:14.719431 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1088e86-f257-44da-b5e5-9de5bd9e1dd4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:14.719909 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1088e86-f257-44da-b5e5-9de5bd9e1dd4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:14.720677 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1088e86-f257-44da-b5e5-9de5bd9e1dd4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:14.721110 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c1088e86-f257-44da-b5e5-9de5bd9e1dd4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:14.794648 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c1088e86-f257-44da-b5e5-9de5bd9e1dd4 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28645 microversion: 2.1 time: 0.086038 Oct 29 13:38:14.795255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 477/929] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:14 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28645 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:15.332897 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:15.333498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:15.339390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.339836 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.340594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.341021 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.457899 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:15.465352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:15.466863 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:15.468034 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3c5f6989-3a88-4cdd-b78c-51eb8f76c8bf tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.138877 Oct 29 13:38:15.468575 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 453/930] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:15 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:15.631795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:15.632477 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:15.638843 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.639307 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.640074 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.640504 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.760389 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:15.767601 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8faa6255-966d-4c9b-a50e-a5079652d534 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1548 microversion: 2.1 time: 0.139879 Oct 29 13:38:15.768162 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 478/931] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:15 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1548 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:15.783353 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:15.783950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:15.789654 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.790118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.790877 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.791302 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.805854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a5a241ae-db67-47f0-8d21-89eb1bd10f3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:15.806815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a5a241ae-db67-47f0-8d21-89eb1bd10f3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:15.813042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5a241ae-db67-47f0-8d21-89eb1bd10f3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.813490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5a241ae-db67-47f0-8d21-89eb1bd10f3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.814276 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5a241ae-db67-47f0-8d21-89eb1bd10f3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.814709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a5a241ae-db67-47f0-8d21-89eb1bd10f3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.899162 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a5a241ae-db67-47f0-8d21-89eb1bd10f3c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 28764 microversion: 2.1 time: 0.096661 Oct 29 13:38:15.899858 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 479/932] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:15 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 28764 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:38:15.911357 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:15.918599 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e0c85421-8942-4d40-94e8-01b84758429f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1548 microversion: 2.1 time: 0.138877 Oct 29 13:38:15.919180 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 454/933] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:15 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1548 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:15.934708 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:15.937979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:15.937979 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:38:15.938947 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:15.939670 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Searching by: {'deleted': False, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547'} {{(pid=122215) get_all /opt/stack/nova/nova/compute/api.py:2905}} Oct 29 13:38:15.946579 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.947026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:15.947831 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:15.948267 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:16.035719 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.multi_cell_list [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122215) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Oct 29 13:38:16.128494 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4580025d-f6b7-4878-abd0-363384349955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197580 Oct 29 13:38:16.129053 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 480/934] 10.222.0.96 () {58 vars in 1124 bytes} [Fri Oct 29 13:38:15 2021] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:16.139033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:16.139637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:16.145287 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:16.145726 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:16.146540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:16.146966 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:16.266691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:16.273671 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8d93fa45-1c50-44ce-a7d3-1f8aa068cc6b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1548 microversion: 2.1 time: 0.138368 Oct 29 13:38:16.274248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 455/935] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:16 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1548 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:16.485643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:16.486482 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:16.492943 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:16.493586 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:16.494440 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:16.494878 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:16.650108 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:16.657931 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:16.659415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:16.660621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a4307eb6-2f71-47af-93f0-b1fd8286283f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.178663 Oct 29 13:38:16.661181 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 481/936] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:16 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:16.911243 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6df03fc0-6a06-4314-bfbf-8c70ff146f24 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:16.912173 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6df03fc0-6a06-4314-bfbf-8c70ff146f24 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:16.917831 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6df03fc0-6a06-4314-bfbf-8c70ff146f24 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:16.918273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6df03fc0-6a06-4314-bfbf-8c70ff146f24 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:16.919029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6df03fc0-6a06-4314-bfbf-8c70ff146f24 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:16.919455 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6df03fc0-6a06-4314-bfbf-8c70ff146f24 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:16.994268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6df03fc0-6a06-4314-bfbf-8c70ff146f24 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 30537 microversion: 2.1 time: 0.086545 Oct 29 13:38:16.994872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 456/937] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:16 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 30537 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:17.678555 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:17.679153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:17.685326 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:17.685791 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:17.687112 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:17.687546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:17.807658 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:17.810087 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-910b4859-26c3-4109-9b70-ec729c6304fa tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "293bdefd-0cc4-4c04-a45f-7dcf0eb3fce5"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:17.811879 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-910b4859-26c3-4109-9b70-ec729c6304fa tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:17.815791 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:17.817261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:17.818412 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b35b3fb7-0b8b-4de1-8def-85cf5e9903cd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.143516 Oct 29 13:38:17.818549 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-910b4859-26c3-4109-9b70-ec729c6304fa tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:17.818957 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 482/938] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:17 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:17.819098 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-910b4859-26c3-4109-9b70-ec729c6304fa tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:17.819855 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-910b4859-26c3-4109-9b70-ec729c6304fa tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:17.820296 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-910b4859-26c3-4109-9b70-ec729c6304fa tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:18.005919 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9f4981ad-610b-4259-989c-e6c26e57615a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:18.006808 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9f4981ad-610b-4259-989c-e6c26e57615a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:18.012558 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f4981ad-610b-4259-989c-e6c26e57615a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:18.013083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f4981ad-610b-4259-989c-e6c26e57615a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:18.014148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f4981ad-610b-4259-989c-e6c26e57615a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:18.014500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9f4981ad-610b-4259-989c-e6c26e57615a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:18.044828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-910b4859-26c3-4109-9b70-ec729c6304fa tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.238986 Oct 29 13:38:18.046172 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 457/939] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:38:17 2021] POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:38:18.103012 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9f4981ad-610b-4259-989c-e6c26e57615a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 32343 microversion: 2.1 time: 0.100483 Oct 29 13:38:18.103630 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 483/940] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:18 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 32343 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:18.837149 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:18.837876 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:18.843926 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:18.844367 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:18.845161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:18.845592 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:18.962697 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:18.970254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:18.971751 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:18.972885 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-bad901e0-9a82-4be0-9ba8-9bf9d2902642 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.139974 Oct 29 13:38:18.973437 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 458/941] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:18 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:19.115511 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-49902d00-4b2b-412c-8249-3fe0af92b54c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:19.116520 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-49902d00-4b2b-412c-8249-3fe0af92b54c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:19.122734 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49902d00-4b2b-412c-8249-3fe0af92b54c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:19.123168 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49902d00-4b2b-412c-8249-3fe0af92b54c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:19.123918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49902d00-4b2b-412c-8249-3fe0af92b54c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:19.124341 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49902d00-4b2b-412c-8249-3fe0af92b54c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:19.199182 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-49902d00-4b2b-412c-8249-3fe0af92b54c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 33301 microversion: 2.1 time: 0.087408 Oct 29 13:38:19.199836 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 484/942] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:19 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 33301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:19.991637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:19.992188 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:19.997974 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:19.998425 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:19.999184 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:19.999880 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:20.115303 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:20.122903 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:20.124396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:20.125838 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d43a8562-cdda-40a9-b757-d37cc41ad9f2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.137945 Oct 29 13:38:20.126959 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 459/943] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:19 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:20.212247 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6f340683-0631-43fb-8b7b-6079c2927231 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:20.213231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6f340683-0631-43fb-8b7b-6079c2927231 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:20.219512 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f340683-0631-43fb-8b7b-6079c2927231 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:20.219955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f340683-0631-43fb-8b7b-6079c2927231 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:20.220709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f340683-0631-43fb-8b7b-6079c2927231 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:20.221136 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6f340683-0631-43fb-8b7b-6079c2927231 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:20.307068 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6f340683-0631-43fb-8b7b-6079c2927231 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 34186 microversion: 2.1 time: 0.098677 Oct 29 13:38:20.307624 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 485/944] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:20 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 34186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:21.144663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:21.145261 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:21.151375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:21.151807 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:21.152560 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:21.152986 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:21.274808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:21.282423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:21.283927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:21.285074 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-57c93373-2516-4bca-b547-b87fd1e4f91f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.144637 Oct 29 13:38:21.285626 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 460/945] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:21 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:21.319675 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8d90f1c4-0c65-4e14-bad3-8a65e0572de7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:21.320658 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8d90f1c4-0c65-4e14-bad3-8a65e0572de7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:21.327018 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c4-0c65-4e14-bad3-8a65e0572de7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:21.327461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c4-0c65-4e14-bad3-8a65e0572de7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:21.328214 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c4-0c65-4e14-bad3-8a65e0572de7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:21.328645 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8d90f1c4-0c65-4e14-bad3-8a65e0572de7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:21.408576 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8d90f1c4-0c65-4e14-bad3-8a65e0572de7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 35326 microversion: 2.1 time: 0.092746 Oct 29 13:38:21.409177 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 486/946] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:21 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 35326 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:22.303098 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:22.303785 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:22.309422 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:22.309896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:22.310665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:22.311093 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:22.420629 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-aa0d1d3f-4ad6-4164-a624-030ef04dcc63 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:22.421786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-aa0d1d3f-4ad6-4164-a624-030ef04dcc63 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:22.428188 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:22.428350 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa0d1d3f-4ad6-4164-a624-030ef04dcc63 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:22.428629 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa0d1d3f-4ad6-4164-a624-030ef04dcc63 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:22.429402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa0d1d3f-4ad6-4164-a624-030ef04dcc63 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:22.429840 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-aa0d1d3f-4ad6-4164-a624-030ef04dcc63 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:22.436077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:22.437585 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:22.438776 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0a939a68-6176-4bf8-b2e9-c27300100550 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.139362 Oct 29 13:38:22.439363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 461/947] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:22 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:38:22.512338 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-aa0d1d3f-4ad6-4164-a624-030ef04dcc63 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 36524 microversion: 2.1 time: 0.095518 Oct 29 13:38:22.512944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 487/948] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:22 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 36524 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:38:23.456701 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:23.457240 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:23.462915 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:23.463365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:23.464131 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:23.464565 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:23.525117 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e9231b28-d565-4262-9c4f-f6f02b64f14c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:23.526186 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e9231b28-d565-4262-9c4f-f6f02b64f14c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:23.532549 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9231b28-d565-4262-9c4f-f6f02b64f14c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:23.532992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9231b28-d565-4262-9c4f-f6f02b64f14c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:23.533759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9231b28-d565-4262-9c4f-f6f02b64f14c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:23.534217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9231b28-d565-4262-9c4f-f6f02b64f14c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:23.582494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:23.590033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:23.591534 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:23.592676 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2593cdf6-4dd4-49ff-9502-54efcc443a2f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1743 microversion: 2.20 time: 0.140453 Oct 29 13:38:23.593231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 462/949] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:23 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1743 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:23.631059 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e9231b28-d565-4262-9c4f-f6f02b64f14c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 37617 microversion: 2.1 time: 0.109797 Oct 29 13:38:23.631692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 488/950] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:23 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 37617 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:38:24.612097 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:24.612694 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:24.618388 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:24.618832 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:24.619593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:24.620028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:24.644437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d8e8c691-45b9-4323-9d57-ff423b3b192e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:24.645336 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d8e8c691-45b9-4323-9d57-ff423b3b192e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:24.651779 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d8e8c691-45b9-4323-9d57-ff423b3b192e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:24.652220 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d8e8c691-45b9-4323-9d57-ff423b3b192e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:24.652983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d8e8c691-45b9-4323-9d57-ff423b3b192e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:24.653407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d8e8c691-45b9-4323-9d57-ff423b3b192e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:24.741467 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d8e8c691-45b9-4323-9d57-ff423b3b192e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 38175 microversion: 2.1 time: 0.102066 Oct 29 13:38:24.742133 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 489/951] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:24 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 38175 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 29 13:38:24.742417 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:24.750572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:24.752055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:24.753191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e1d170bf-d7ee-41ea-8581-eb63964d9fef tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1743 microversion: 2.20 time: 0.144879 Oct 29 13:38:24.753734 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 463/952] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:24 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1743 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:25.604710 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:25.605406 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:25.612500 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:25.612944 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:25.613706 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:25.614169 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:25.732444 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:25.740762 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dd819cf2-b35b-4351-804f-95c6c5a0a70f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1594 microversion: 2.1 time: 0.140002 Oct 29 13:38:25.741324 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 490/953] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:25 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1594 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:25.752469 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fa962eac-6bca-43fa-aa08-6e1e6ba402ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:25.753601 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fa962eac-6bca-43fa-aa08-6e1e6ba402ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:25.759993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa962eac-6bca-43fa-aa08-6e1e6ba402ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:25.760449 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa962eac-6bca-43fa-aa08-6e1e6ba402ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:25.761223 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa962eac-6bca-43fa-aa08-6e1e6ba402ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:25.761658 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fa962eac-6bca-43fa-aa08-6e1e6ba402ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:25.770728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:25.771329 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:25.777656 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:25.778573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:25.779645 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:25.780836 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:25.830950 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fa962eac-6bca-43fa-aa08-6e1e6ba402ef tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 38175 microversion: 2.1 time: 0.082153 Oct 29 13:38:25.832419 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 464/954] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:25 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 38175 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:25.904052 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:25.912306 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:25.913802 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:25.914959 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-5f8c14b7-e833-4d5a-865f-c31600b903e6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1743 microversion: 2.20 time: 0.147806 Oct 29 13:38:25.915515 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 491/955] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:25 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1743 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:38:26.096475 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-73421cd7-1233-4466-aa17-d43a8c4bf78b req-678518c0-e928-4517-b605-8af35b784f39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c9065a-62c0-4f58-82af-bd44e7a1ac45", "name": "network-vif-plugged", "status": "completed", "tag": "207037ea-0c28-45f2-b0bb-bf243c80aa97"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:26.098134 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:26.098134 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:38:26.106240 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-73421cd7-1233-4466-aa17-d43a8c4bf78b req-678518c0-e928-4517-b605-8af35b784f39 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:26.106802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-73421cd7-1233-4466-aa17-d43a8c4bf78b req-678518c0-e928-4517-b605-8af35b784f39 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:26.117952 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-73421cd7-1233-4466-aa17-d43a8c4bf78b req-678518c0-e928-4517-b605-8af35b784f39 service nova] Creating event network-vif-plugged:207037ea-0c28-45f2-b0bb-bf243c80aa97 for instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 on hv-cinder-81588 Oct 29 13:38:26.123007 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-73421cd7-1233-4466-aa17-d43a8c4bf78b req-678518c0-e928-4517-b605-8af35b784f39 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031078 Oct 29 13:38:26.123705 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 465/956] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:26.842854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-18bef5a3-0d6c-45f7-ba64-d2cf309c274e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:26.845054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-18bef5a3-0d6c-45f7-ba64-d2cf309c274e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:26.854401 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18bef5a3-0d6c-45f7-ba64-d2cf309c274e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:26.855116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18bef5a3-0d6c-45f7-ba64-d2cf309c274e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:26.856443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18bef5a3-0d6c-45f7-ba64-d2cf309c274e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:26.857323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-18bef5a3-0d6c-45f7-ba64-d2cf309c274e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:26.934417 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:26.935119 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:26.942525 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-18bef5a3-0d6c-45f7-ba64-d2cf309c274e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 38175 microversion: 2.1 time: 0.103321 Oct 29 13:38:26.945397 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:26.946164 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 492/957] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:26 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 38175 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:26.956919 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:26.958000 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:26.958526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:27.212544 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:27.221235 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:27.223356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:27.224709 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2fdd2095-fe7e-450c-95bc-19c868699ba8 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.294394 Oct 29 13:38:27.225440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 466/958] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:26 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:38:27.667819 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-db413c95-1ded-4bb4-8f51-1bb6fe4c4f81 req-b3fdab70-b08d-44de-9f9d-e6ca8de49a74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471017e8-2ba0-4199-9c0a-732ae35252f4", "tag": "a6f1c1d1-b296-47fe-861a-d306e40696a7"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:27.669281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:27.669281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:38:27.681636 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-db413c95-1ded-4bb4-8f51-1bb6fe4c4f81 req-b3fdab70-b08d-44de-9f9d-e6ca8de49a74 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:27.682106 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-db413c95-1ded-4bb4-8f51-1bb6fe4c4f81 req-b3fdab70-b08d-44de-9f9d-e6ca8de49a74 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:27.708126 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-db413c95-1ded-4bb4-8f51-1bb6fe4c4f81 req-b3fdab70-b08d-44de-9f9d-e6ca8de49a74 service nova] Creating event network-changed:a6f1c1d1-b296-47fe-861a-d306e40696a7 for instance 471017e8-2ba0-4199-9c0a-732ae35252f4 on hv-cinder-81588 Oct 29 13:38:27.724377 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-db413c95-1ded-4bb4-8f51-1bb6fe4c4f81 req-b3fdab70-b08d-44de-9f9d-e6ca8de49a74 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060685 Oct 29 13:38:27.724890 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 493/959] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:27.955700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ea328c0a-ad3a-4d1e-9349-174652026bd0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:27.957252 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ea328c0a-ad3a-4d1e-9349-174652026bd0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:27.976599 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ea328c0a-ad3a-4d1e-9349-174652026bd0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:27.976968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ea328c0a-ad3a-4d1e-9349-174652026bd0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:27.978338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ea328c0a-ad3a-4d1e-9349-174652026bd0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:27.978978 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ea328c0a-ad3a-4d1e-9349-174652026bd0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:28.084423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ea328c0a-ad3a-4d1e-9349-174652026bd0 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action" status: 200 len: 38304 microversion: 2.1 time: 0.131677 Oct 29 13:38:28.091936 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 467/960] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:27 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/action => generated 38304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:28.100687 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b1b8b1b7-fe15-4249-883a-ca08ccb05031 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:28.101977 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b1b8b1b7-fe15-4249-883a-ca08ccb05031 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:28.112254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1b7-fe15-4249-883a-ca08ccb05031 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:28.116644 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1b7-fe15-4249-883a-ca08ccb05031 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:28.117688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1b7-fe15-4249-883a-ca08ccb05031 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:28.121160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b1b8b1b7-fe15-4249-883a-ca08ccb05031 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:28.177035 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b1b8b1b7-fe15-4249-883a-ca08ccb05031 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/ips" status: 200 len: 144 microversion: 2.1 time: 0.084335 Oct 29 13:38:28.186311 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 494/961] 10.222.0.96 () {58 vars in 1247 bytes} [Fri Oct 29 13:38:28 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/ips => generated 144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:38:28.244650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:28.245516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:28.257996 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:28.258446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:28.259222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:28.259651 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:28.608256 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:28.641075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:28.657204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:28.663339 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-08788560-c2f6-4eb8-a3e5-2d1311a64bf6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.423611 Oct 29 13:38:28.674483 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 468/962] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:28 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:29.597217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2108735566"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:29.597837 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:29.603798 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:29.604237 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:29.605181 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:29.605793 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:29.685599 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:29.686232 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:29.698124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:29.698571 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:29.699355 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:29.699783 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:29.860163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:29.871680 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:29.873836 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:29.875597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-58d8060a-12df-4878-85a7-4d0c120407dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.193761 Oct 29 13:38:29.877892 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 469/963] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:29 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:29.957711 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-98867ef9-e1e1-473f-b60b-59978fbbd1b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "955faf8c-2577-4ef3-b8bc-541532ba838a"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:29.960037 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-98867ef9-e1e1-473f-b60b-59978fbbd1b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:29.966326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98867ef9-e1e1-473f-b60b-59978fbbd1b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:29.966775 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98867ef9-e1e1-473f-b60b-59978fbbd1b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:29.967813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98867ef9-e1e1-473f-b60b-59978fbbd1b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:29.968444 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-98867ef9-e1e1-473f-b60b-59978fbbd1b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:29.992503 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.network.security_group_api [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Adding security group 31c31add-f029-4a31-90ed-b8e46ee3a507 to port a6f1c1d1-b296-47fe-861a-d306e40696a7 Oct 29 13:38:30.336750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-98867ef9-e1e1-473f-b60b-59978fbbd1b3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383467 Oct 29 13:38:30.337371 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 470/964] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:38:29 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:38:30.440329 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-09228edf-6a1e-45a5-86ca-c82a8cde3955 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/action" status: 202 len: 0 microversion: 2.1 time: 0.845966 Oct 29 13:38:30.442453 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 495/965] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:38:29 2021] POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:38:30.451803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:30.452639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:30.464510 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:30.465276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:30.466692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:30.467301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:30.515095 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-b5f59c18-b847-4a2e-9460-849f846b0eae req-0f03e26c-cd61-4e92-b62d-4dbeb7b14eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471017e8-2ba0-4199-9c0a-732ae35252f4", "tag": "a6f1c1d1-b296-47fe-861a-d306e40696a7"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:30.517570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:30.517570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:38:30.545013 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-b5f59c18-b847-4a2e-9460-849f846b0eae req-0f03e26c-cd61-4e92-b62d-4dbeb7b14eb5 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:30.554538 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-b5f59c18-b847-4a2e-9460-849f846b0eae req-0f03e26c-cd61-4e92-b62d-4dbeb7b14eb5 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:30.588923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-b5f59c18-b847-4a2e-9460-849f846b0eae req-0f03e26c-cd61-4e92-b62d-4dbeb7b14eb5 service nova] Creating event network-changed:a6f1c1d1-b296-47fe-861a-d306e40696a7 for instance 471017e8-2ba0-4199-9c0a-732ae35252f4 on hv-cinder-81588 Oct 29 13:38:30.599923 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-b5f59c18-b847-4a2e-9460-849f846b0eae req-0f03e26c-cd61-4e92-b62d-4dbeb7b14eb5 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089101 Oct 29 13:38:30.604999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 496/966] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:38:30.771570 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:30.782226 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-689a3a97-9340-49fd-8c94-fcbcb5ba7377 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1758 microversion: 2.1 time: 0.334232 Oct 29 13:38:30.799296 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 471/967] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:38:30 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1758 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:38:30.896729 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:30.898053 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:30.908708 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:30.909477 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:30.910550 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:30.912042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:31.202638 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:31.220855 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:31.229308 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:31.232964 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b73827b1-cfad-42ac-bbb5-c465b6d998fc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.340978 Oct 29 13:38:31.239653 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 497/968] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:30 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:32.264241 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:32.264805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:32.277374 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:32.277842 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:32.290866 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:32.291309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:32.439395 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:32.448320 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:32.450451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:32.451826 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9b25febf-1846-49be-8e84-dfd4a7b24992 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.198740 Oct 29 13:38:32.464586 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 472/969] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:32 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:33.472396 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:33.473645 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:33.481246 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:33.482110 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:33.483107 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:33.483618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:33.639222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:33.649837 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:33.651597 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:33.652947 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0eb5616c-b202-42ce-bac9-658c6ca19121 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.184618 Oct 29 13:38:33.653491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 498/970] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:33 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:34.672266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:34.672861 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:34.683130 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:34.683927 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:34.685131 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:34.685750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:34.819128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:34.827732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:34.829678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:34.830957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d3cb200b-19fd-4c89-942b-60d8a9a058eb tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.162354 Oct 29 13:38:34.831831 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 473/971] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:34 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:35.849609 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:35.851130 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:35.857280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:35.858049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:35.859060 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:35.859671 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:35.990739 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:35.999616 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:36.001369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:36.002596 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-03ee94f1-c4fe-49cf-98be-59dd7a6cb9c9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1738 microversion: 2.20 time: 0.157622 Oct 29 13:38:36.006262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 499/972] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:35 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:37.020944 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:37.021573 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:37.027355 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:37.027744 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:37.028506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:37.028944 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:37.147675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:37.155989 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:37.157478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:37.158670 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5f67b278-f70b-4227-a3ef-43b713ccc8b6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1720 microversion: 2.20 time: 0.142146 Oct 29 13:38:37.159231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 474/973] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:37 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1720 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:37.937520 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4f5d179c-27a8-437c-b5c8-ce3ea506c37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:37.938470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4f5d179c-27a8-437c-b5c8-ce3ea506c37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:37.944616 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4f5d179c-27a8-437c-b5c8-ce3ea506c37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:37.945057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4f5d179c-27a8-437c-b5c8-ce3ea506c37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:37.945843 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4f5d179c-27a8-437c-b5c8-ce3ea506c37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:37.946276 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4f5d179c-27a8-437c-b5c8-ce3ea506c37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:37.975486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4f5d179c-27a8-437c-b5c8-ce3ea506c37a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041690 Oct 29 13:38:37.976025 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 500/974] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:38:37 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:37.985627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-56d2dc19-3115-4ae1-8260-42138e9f1e7b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:37.986155 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-56d2dc19-3115-4ae1-8260-42138e9f1e7b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:37.992435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-56d2dc19-3115-4ae1-8260-42138e9f1e7b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:37.992890 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-56d2dc19-3115-4ae1-8260-42138e9f1e7b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:37.993660 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-56d2dc19-3115-4ae1-8260-42138e9f1e7b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:37.994124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-56d2dc19-3115-4ae1-8260-42138e9f1e7b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:38.021962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-56d2dc19-3115-4ae1-8260-42138e9f1e7b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/955faf8c-2577-4ef3-b8bc-541532ba838a" status: 200 len: 194 microversion: 2.1 time: 0.040005 Oct 29 13:38:38.022919 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 475/975] 10.222.0.96 () {58 vars in 1412 bytes} [Fri Oct 29 13:38:37 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/955faf8c-2577-4ef3-b8bc-541532ba838a => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:38.177935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:38.178533 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:38.184342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:38.184779 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:38.185531 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:38.185994 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:38.326181 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:38.333958 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:38.335440 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:38.336580 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-f64cf1b4-2d08-497e-bc8c-c39ecead418e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1720 microversion: 2.20 time: 0.163450 Oct 29 13:38:38.337132 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 501/976] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:38 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:39.340553 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6861552e-0369-4b5e-98f4-6911a2f5d9b8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b526775b-d81b-4757-99aa-e8c4e23b1306"}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:39.341675 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6861552e-0369-4b5e-98f4-6911a2f5d9b8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:39.348493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6861552e-0369-4b5e-98f4-6911a2f5d9b8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:39.348942 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6861552e-0369-4b5e-98f4-6911a2f5d9b8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:39.349799 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6861552e-0369-4b5e-98f4-6911a2f5d9b8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:39.350259 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6861552e-0369-4b5e-98f4-6911a2f5d9b8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:39.354559 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:39.355158 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:39.360745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:39.361182 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:39.361959 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:39.362415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:39.486858 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:39.495223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:39.496711 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:39.497870 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a0586947-bd96-4f5e-ad0c-76c5512f817b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1720 microversion: 2.20 time: 0.147046 Oct 29 13:38:39.498407 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 502/977] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:39 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:38:39.583010 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6861552e-0369-4b5e-98f4-6911a2f5d9b8 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.246002 Oct 29 13:38:39.583635 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 476/978] 10.222.0.96 () {60 vars in 1322 bytes} [Fri Oct 29 13:38:39 2021] POST /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments => generated 194 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:40.113054 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-6fea707b-49e3-4ef7-9e16-743e41e3e5d1 req-8ade74f0-e03a-44ab-a39e-a973c94e90e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c9065a-62c0-4f58-82af-bd44e7a1ac45", "name": "network-vif-unplugged", "status": "completed", "tag": "207037ea-0c28-45f2-b0bb-bf243c80aa97"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:40.115003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:38:40.115003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:38:40.123454 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-6fea707b-49e3-4ef7-9e16-743e41e3e5d1 req-8ade74f0-e03a-44ab-a39e-a973c94e90e2 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:40.123891 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-6fea707b-49e3-4ef7-9e16-743e41e3e5d1 req-8ade74f0-e03a-44ab-a39e-a973c94e90e2 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:40.136880 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.compute.server_external_events [req-6fea707b-49e3-4ef7-9e16-743e41e3e5d1 req-8ade74f0-e03a-44ab-a39e-a973c94e90e2 service nova] Unable to find a host for instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45. Dropping event network-vif-unplugged {{(pid=122215) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 29 13:38:40.137973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-6fea707b-49e3-4ef7-9e16-743e41e3e5d1 req-8ade74f0-e03a-44ab-a39e-a973c94e90e2 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029352 Oct 29 13:38:40.138816 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 503/979] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:38:40 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 13:38:40.517251 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:40.517923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:40.526707 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:40.527154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:40.527921 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:40.528355 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:40.645701 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:40.653881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:40.655372 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:40.656513 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d6e567b0-ba8f-4ca1-8c2a-268ea5094c0a tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1663 microversion: 2.20 time: 0.143863 Oct 29 13:38:40.657063 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 477/980] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:40 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1663 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:38:40.674537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-971cce5c-ad4d-4d3b-94a2-5c039e711871 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffb02111-74a9-40af-9fad-ef69fd54b84b"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:40.676255 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-971cce5c-ad4d-4d3b-94a2-5c039e711871 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:40.682140 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-971cce5c-ad4d-4d3b-94a2-5c039e711871 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:40.682579 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-971cce5c-ad4d-4d3b-94a2-5c039e711871 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:40.683332 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-971cce5c-ad4d-4d3b-94a2-5c039e711871 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:40.683905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-971cce5c-ad4d-4d3b-94a2-5c039e711871 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:40.932019 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-971cce5c-ad4d-4d3b-94a2-5c039e711871 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.261292 Oct 29 13:38:40.932602 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 504/981] 10.222.0.96 () {62 vars in 1363 bytes} [Fri Oct 29 13:38:40 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-volume_attachments => generated 188 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 29 13:38:41.049759 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-d3921772-d44b-4a73-816f-bdddb789c14d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:41.050270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-d3921772-d44b-4a73-816f-bdddb789c14d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:41.056023 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3921772-d44b-4a73-816f-bdddb789c14d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:41.056464 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3921772-d44b-4a73-816f-bdddb789c14d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:41.057225 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3921772-d44b-4a73-816f-bdddb789c14d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:41.057658 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-d3921772-d44b-4a73-816f-bdddb789c14d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:41.301072 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-d3921772-d44b-4a73-816f-bdddb789c14d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-volume_attachments/ffb02111-74a9-40af-9fad-ef69fd54b84b" status: 202 len: 0 microversion: 2.20 time: 0.254832 Oct 29 13:38:41.301579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 478/982] 10.222.0.96 () {60 vars in 1456 bytes} [Fri Oct 29 13:38:41 2021] DELETE /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-volume_attachments/ffb02111-74a9-40af-9fad-ef69fd54b84b => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:38:41.360795 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0fbf4ea2-ec7b-43b6-8e6a-a5ed4186a211 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:38:41.361350 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0fbf4ea2-ec7b-43b6-8e6a-a5ed4186a211 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:41.367518 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbf4ea2-ec7b-43b6-8e6a-a5ed4186a211 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:41.367967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbf4ea2-ec7b-43b6-8e6a-a5ed4186a211 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:41.368696 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbf4ea2-ec7b-43b6-8e6a-a5ed4186a211 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:41.369115 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0fbf4ea2-ec7b-43b6-8e6a-a5ed4186a211 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:41.456032 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0fbf4ea2-ec7b-43b6-8e6a-a5ed4186a211 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action" status: 202 len: 0 microversion: 2.20 time: 0.098861 Oct 29 13:38:41.456736 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 505/983] 10.222.0.96 () {62 vars in 1318 bytes} [Fri Oct 29 13:38:41 2021] POST /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:38:41.464639 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:41.465247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:41.471005 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:41.471451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:41.472219 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:41.472771 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:41.598636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:41.606828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:41.608398 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:41.609808 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-78e20066-727a-481a-be19-a6a71ad0e457 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1671 microversion: 2.20 time: 0.148684 Oct 29 13:38:41.610248 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 479/984] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:41 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1671 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:42.629146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:42.629744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:42.635389 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:42.635838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:42.636584 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:42.637007 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:42.836217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:42.843775 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:42.845232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:42.846387 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-92a37369-b483-4f21-9c73-3bff4d75a22d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.221832 Oct 29 13:38:42.847505 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 506/985] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:42 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:43.866016 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:43.866627 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:43.873058 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:43.873502 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:43.874309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:43.875009 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:43.997052 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:44.005523 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:44.007188 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:44.008553 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5be3562d-3194-4e7a-9032-8494e48560d5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.146839 Oct 29 13:38:44.009941 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 480/986] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:43 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:45.027153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:45.027744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:45.033561 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:45.034040 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:45.034811 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:45.035223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:45.158175 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:45.168728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:45.170231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:45.171376 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8f04166a-2b5a-4d32-bc10-57c697142c45 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.148005 Oct 29 13:38:45.172118 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 507/987] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:45 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:46.190130 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:46.190833 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:46.196909 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:46.197374 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:46.198165 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:46.198595 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:46.330904 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:46.339304 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:46.340819 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:46.342000 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8bf4e101-e05b-48b4-a1e5-357184121e72 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.155605 Oct 29 13:38:46.342558 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 481/988] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:46 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:47.361353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:47.362134 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:47.368864 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:47.369310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:47.370162 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:47.370594 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:47.502808 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:47.510343 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:47.511825 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:47.512953 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2655d7c6-781d-434f-86bd-a36b2f9f02a5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.156272 Oct 29 13:38:47.513509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 508/989] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:47 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:48.531358 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:48.531975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:48.538578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:48.539015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:48.539767 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:48.540190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:48.677156 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:48.685275 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:48.686756 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:48.687906 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f58e411e-9dc3-4a3a-8abd-811a1d03c0dd tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.160228 Oct 29 13:38:48.696085 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 482/990] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:48 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:49.705786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:49.706430 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:49.712867 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:49.713309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:49.714086 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:49.714516 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:49.845286 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:49.853623 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:49.855158 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:49.856320 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-49f852c3-a197-4061-abe6-0e967dc74eed tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.154215 Oct 29 13:38:49.856872 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 509/991] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:49 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:50.875415 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:50.876045 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:50.883433 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:50.884146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:50.885048 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:50.885526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:51.013484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:51.020805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:51.022648 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:51.024110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-7b9d9ee2-db91-4fe1-bc6b-6fa216618227 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.152859 Oct 29 13:38:51.024870 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 483/992] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:50 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:52.043182 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:52.043815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:52.050152 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:52.050599 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:52.051663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:52.052096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:52.178776 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:52.188069 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:52.189607 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:52.190793 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fa64de75-9fa4-4be6-a05b-9bf1fb7f6e30 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.151468 Oct 29 13:38:52.191346 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 510/993] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:52 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:53.208773 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:53.209410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:53.215584 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:53.216034 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:53.216815 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:53.217254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:53.344469 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:53.352310 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:53.353822 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:53.354971 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-17a1bdf8-1f68-49a7-9a68-9e899b5c430e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.150034 Oct 29 13:38:53.355525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 484/994] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:53 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:54.374447 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:54.375342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:54.381575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:54.382047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:54.382808 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:54.383238 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:54.520178 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:54.530426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:54.532787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:54.534704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cf5f8811-489d-438e-b816-b462e51b2aea tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.163912 Oct 29 13:38:54.538877 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 511/995] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:54 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:55.553038 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:55.553613 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:55.559326 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:55.559762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:55.560508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:55.560930 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:55.936776 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:55.944665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:55.946638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:55.947474 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-36add9a2-3120-42ef-b83e-fef538e2b4d9 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.398144 Oct 29 13:38:55.948019 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 485/996] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:55 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:56.965464 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:56.966105 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:56.971818 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:56.972283 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:56.973031 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:56.973457 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:57.091627 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:57.099111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:57.100569 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:57.101696 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-95b83909-3eaa-4b66-99aa-3a6fae99eb5b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.139865 Oct 29 13:38:57.102272 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 512/997] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:56 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:57.684278 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1083ce8b-0fa6-4953-9fb3-0806a13093d7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:57.685227 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1083ce8b-0fa6-4953-9fb3-0806a13093d7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:57.691606 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1083ce8b-0fa6-4953-9fb3-0806a13093d7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:57.692106 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1083ce8b-0fa6-4953-9fb3-0806a13093d7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:57.692874 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1083ce8b-0fa6-4953-9fb3-0806a13093d7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:57.693309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1083ce8b-0fa6-4953-9fb3-0806a13093d7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:57.722313 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1083ce8b-0fa6-4953-9fb3-0806a13093d7 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.041731 Oct 29 13:38:57.722858 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 486/998] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:38:57 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:58.013567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-deae2700-f2f5-43dc-8690-a6dae316f71b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:58.014102 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-deae2700-f2f5-43dc-8690-a6dae316f71b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:58.019813 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-deae2700-f2f5-43dc-8690-a6dae316f71b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:58.020260 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-deae2700-f2f5-43dc-8690-a6dae316f71b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:58.021534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-deae2700-f2f5-43dc-8690-a6dae316f71b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:58.022004 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-deae2700-f2f5-43dc-8690-a6dae316f71b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:58.050491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-deae2700-f2f5-43dc-8690-a6dae316f71b tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/955faf8c-2577-4ef3-b8bc-541532ba838a" status: 200 len: 194 microversion: 2.1 time: 0.040630 Oct 29 13:38:58.051085 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 513/999] 10.222.0.96 () {58 vars in 1412 bytes} [Fri Oct 29 13:38:58 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/955faf8c-2577-4ef3-b8bc-541532ba838a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:38:58.060492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:58.061017 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:58.067066 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:58.067516 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:58.068327 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:58.068750 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:58.119491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:58.120085 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:58.126028 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:58.126467 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:58.127218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:58.127643 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:58.152666 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.objects.instance [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lazy-loading 'services' on Instance uuid ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 {{(pid=122216) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:38:58.218467 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ad584c27-b254-4815-b77c-56f6c833272e tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/955faf8c-2577-4ef3-b8bc-541532ba838a" status: 202 len: 0 microversion: 2.1 time: 0.161436 Oct 29 13:38:58.219049 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 487/1000] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:38:58 2021] DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/955faf8c-2577-4ef3-b8bc-541532ba838a => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:38:58.254842 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:58.263780 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:58.265371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:58.266797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-782ac314-5bd4-4f45-9c16-8f73744a4e0b tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.150946 Oct 29 13:38:58.267379 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 514/1001] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:58 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 29 13:38:59.286206 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:59.286967 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:59.293407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:59.293880 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:59.294657 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:59.295147 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:59.342905 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-555453c2-160a-4726-ac1f-819cd365ff71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:59.343479 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-555453c2-160a-4726-ac1f-819cd365ff71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:59.349268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-555453c2-160a-4726-ac1f-819cd365ff71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:59.349713 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-555453c2-160a-4726-ac1f-819cd365ff71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:59.350508 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-555453c2-160a-4726-ac1f-819cd365ff71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:59.350969 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-555453c2-160a-4726-ac1f-819cd365ff71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:59.381153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-555453c2-160a-4726-ac1f-819cd365ff71 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/b526775b-d81b-4757-99aa-e8c4e23b1306" status: 200 len: 194 microversion: 2.1 time: 0.041370 Oct 29 13:38:59.381674 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 515/1002] 10.222.0.96 () {58 vars in 1412 bytes} [Fri Oct 29 13:38:59 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/b526775b-d81b-4757-99aa-e8c4e23b1306 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:38:59.390845 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:38:59.391333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:38:59.397147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:59.397594 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:59.398427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:38:59.398866 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:38:59.421970 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:59.430135 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:59.431615 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:38:59.432755 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3efc36fa-0e6a-4edb-88a3-c1200c32e6e7 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.150885 Oct 29 13:38:59.433300 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 488/1003] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:38:59 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:38:59.480293 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lazy-loading 'services' on Instance uuid ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:38:59.542417 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0929377d-7b19-4c0a-922c-0966163c55c2 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/b526775b-d81b-4757-99aa-e8c4e23b1306" status: 202 len: 0 microversion: 2.1 time: 0.154867 Oct 29 13:38:59.543337 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 516/1004] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:38:59 2021] DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments/b526775b-d81b-4757-99aa-e8c4e23b1306 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:39:00.451273 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:00.451910 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:00.457958 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.458405 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.459761 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.460217 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.578993 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:00.587253 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:00.588738 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:00.589908 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f6dec6c1-f438-4907-9151-9c459ea2bdb1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.142443 Oct 29 13:39:00.590488 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 489/1005] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:00 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:00.712033 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-23f850e8-1b86-4ce5-b6fe-5084c9dea7c3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:00.713278 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-23f850e8-1b86-4ce5-b6fe-5084c9dea7c3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:00.719216 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-23f850e8-1b86-4ce5-b6fe-5084c9dea7c3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.719656 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-23f850e8-1b86-4ce5-b6fe-5084c9dea7c3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.720410 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-23f850e8-1b86-4ce5-b6fe-5084c9dea7c3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.720833 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-23f850e8-1b86-4ce5-b6fe-5084c9dea7c3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.748606 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-23f850e8-1b86-4ce5-b6fe-5084c9dea7c3 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041515 Oct 29 13:39:00.749128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 517/1006] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:39:00 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:39:00.860393 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-00e49113-1ace-46dc-8440-0feff048bb98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:00.861347 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-00e49113-1ace-46dc-8440-0feff048bb98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:00.868125 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00e49113-1ace-46dc-8440-0feff048bb98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.868574 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00e49113-1ace-46dc-8440-0feff048bb98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.869342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00e49113-1ace-46dc-8440-0feff048bb98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.869795 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-00e49113-1ace-46dc-8440-0feff048bb98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.898492 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-00e49113-1ace-46dc-8440-0feff048bb98 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041787 Oct 29 13:39:00.899039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 490/1007] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:39:00 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 29 13:39:00.956689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:00.957179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:00.963365 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.963807 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.964559 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:00.964989 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:00.988886 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:39:01.060661 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6b06fc22-8690-478c-a06d-8433d703446a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 204 len: 0 microversion: 2.1 time: 0.107231 Oct 29 13:39:01.061201 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 518/1008] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:39:00 2021] DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:39:01.069330 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:01.069983 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:01.075658 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:01.076150 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:01.076924 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:01.077362 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:01.196960 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:01.204122 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-87952a44-ffc1-433a-9361-47f7c377043f tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1670 microversion: 2.1 time: 0.138453 Oct 29 13:39:01.204694 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 491/1009] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:01 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1670 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:01.608142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:01.608831 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:01.614590 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:01.615531 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:01.616284 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:01.616710 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:01.734764 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:01.742305 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:01.743785 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:01.744921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2cc3577c-0732-4331-b2db-79136fc7d0aa tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.140768 Oct 29 13:39:01.745472 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 519/1010] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:01 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:02.203137 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-2ee38f6b-c3ca-4c9f-920f-e2cd313ca25f req-bda498c4-5efb-4020-9536-84d1087b45a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c9065a-62c0-4f58-82af-bd44e7a1ac45", "name": "network-vif-plugged", "status": "completed", "tag": "207037ea-0c28-45f2-b0bb-bf243c80aa97"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:02.204618 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:02.204618 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:39:02.212338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2ee38f6b-c3ca-4c9f-920f-e2cd313ca25f req-bda498c4-5efb-4020-9536-84d1087b45a3 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:02.212795 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2ee38f6b-c3ca-4c9f-920f-e2cd313ca25f req-bda498c4-5efb-4020-9536-84d1087b45a3 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:02.222011 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:02.222787 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:02.224159 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-2ee38f6b-c3ca-4c9f-920f-e2cd313ca25f req-bda498c4-5efb-4020-9536-84d1087b45a3 service nova] Creating event network-vif-plugged:207037ea-0c28-45f2-b0bb-bf243c80aa97 for instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 on hv-cinder-81588 Oct 29 13:39:02.229497 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-2ee38f6b-c3ca-4c9f-920f-e2cd313ca25f req-bda498c4-5efb-4020-9536-84d1087b45a3 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030016 Oct 29 13:39:02.230295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 492/1011] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:02.230858 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:02.231563 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:02.232443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:02.233196 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:02.361232 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:02.369475 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-81306ff4-292e-46c0-a0e4-e79f92169e23 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1670 microversion: 2.1 time: 0.151327 Oct 29 13:39:02.370081 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 520/1012] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:02 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:02.763738 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:02.764346 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:02.770095 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:02.770535 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:02.771286 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:02.771766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:02.892735 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:02.900374 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:02.901885 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:02.903018 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0c4b3207-db7c-4179-bc18-b26aa8791a8e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.143435 Oct 29 13:39:02.903566 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 493/1013] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:02 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:03.133763 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dbf51508-0bec-4c5b-94ea-e4c59593f396 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:03.134777 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dbf51508-0bec-4c5b-94ea-e4c59593f396 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:03.140473 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbf51508-0bec-4c5b-94ea-e4c59593f396 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.140915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbf51508-0bec-4c5b-94ea-e4c59593f396 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:03.141676 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbf51508-0bec-4c5b-94ea-e4c59593f396 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.142146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dbf51508-0bec-4c5b-94ea-e4c59593f396 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:03.211342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dbf51508-0bec-4c5b-94ea-e4c59593f396 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/action" status: 202 len: 0 microversion: 2.1 time: 0.081001 Oct 29 13:39:03.211955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 521/1014] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:39:03 2021] POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:39:03.219852 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:03.220451 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:03.226845 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.227392 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:03.228070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.228497 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:03.388063 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:03.388692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:03.394898 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.395381 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:03.396773 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.397207 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:03.418949 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:03.427301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e1ec98c6-61c2-4cf7-82e2-b2b74df995ac tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1750 microversion: 2.1 time: 0.211001 Oct 29 13:39:03.427905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 494/1015] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:03 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1750 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:03.602829 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:03.610056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-638cfae0-9c4f-419e-883b-8083086d1a9a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1670 microversion: 2.1 time: 0.226313 Oct 29 13:39:03.610815 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 522/1016] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:03 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1670 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:03.921580 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:03.924633 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:03.933692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.934207 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:03.935396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:03.936065 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:04.183544 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:04.194110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:04.195538 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:04.196694 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ad2848b0-f01d-46c2-a31a-1575dffff731 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1729 microversion: 2.20 time: 0.278910 Oct 29 13:39:04.197255 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 495/1017] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:03 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1729 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:04.281638 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-6ab6d165-1e45-4178-b74f-62156ff1ff9f req-57551afa-2776-4d43-8500-3535e9bf085c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4", "name": "network-vif-deleted", "tag": "bbd097dd-ea19-4a4e-a3ed-ffc024cf517d"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:04.283311 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:04.283311 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:39:04.290533 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-6ab6d165-1e45-4178-b74f-62156ff1ff9f req-57551afa-2776-4d43-8500-3535e9bf085c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:04.291078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-6ab6d165-1e45-4178-b74f-62156ff1ff9f req-57551afa-2776-4d43-8500-3535e9bf085c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:04.304895 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-6ab6d165-1e45-4178-b74f-62156ff1ff9f req-57551afa-2776-4d43-8500-3535e9bf085c service nova] Creating event network-vif-deleted:bbd097dd-ea19-4a4e-a3ed-ffc024cf517d for instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 on hv-cinder-81588 Oct 29 13:39:04.310356 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-6ab6d165-1e45-4178-b74f-62156ff1ff9f req-57551afa-2776-4d43-8500-3535e9bf085c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Oct 29 13:39:04.313907 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 523/1018] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:04.445372 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:04.446311 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:04.452077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:04.452604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:04.453452 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:04.454005 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:04.576752 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:04.584638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f608938a-591f-4b93-8ba3-476413619e4e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.143608 Oct 29 13:39:04.585329 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 496/1019] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:04 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:04.627709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:04.628509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:04.635226 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:04.635669 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:04.636436 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:04.636865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:04.666303 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:04.666744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:04.667184 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lazy-loading 'fault' on Instance uuid ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:39:04.711578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22a929341e7342ea9ad10ff06b40fbf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f8248bc18c44ce3a53d399a2faba011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:04.719644 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-562526e5-754e-4410-b499-771e53ffbfd5 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 200 len: 1326 microversion: 2.1 time: 0.096189 Oct 29 13:39:04.720211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 524/1020] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:04 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:05.215484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:05.216006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:05.222128 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:05.222574 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:05.223356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:05.223785 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:05.344848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:05.353460 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:05.355173 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:05.356197 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e966a62c-0a3e-4a9e-a66e-0ee19c95730d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1716 microversion: 2.20 time: 0.144536 Oct 29 13:39:05.357079 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 497/1021] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:05 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1716 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:05.601949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:05.602563 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:05.608362 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:05.608806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:05.609567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:05.610027 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:05.727310 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:05.734991 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-db35df8e-e7f0-4c3b-a205-93839d702ff6 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.137349 Oct 29 13:39:05.735552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 525/1022] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:05 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:05.736886 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:05.737526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:05.743214 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:05.743662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:05.744481 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:05.744918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:05.758597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] HTTP exception thrown: Instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 could not be found. Oct 29 13:39:05.759173 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Returning 404 to user: Instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:05.760008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-20bc5833-72b1-4507-b8d7-13b27a300f14 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 404 len: 111 microversion: 2.1 time: 0.026816 Oct 29 13:39:05.760520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 498/1023] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:05 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:39:05.768340 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-eb8b5879-2248-4bdd-9793-01ad4185cc92 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '.version_select at 0x7f548002fca0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:05.788712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-eb8b5879-2248-4bdd-9793-01ad4185cc92 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288105848" status: 202 len: 0 microversion: 2.1 time: 0.023854 Oct 29 13:39:05.789261 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 526/1024] 10.222.0.96 () {58 vars in 1217 bytes} [Fri Oct 29 13:39:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288105848 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:39:06.665272 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:06.665692 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:06.671995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:06.671995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:06.672744 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:06.673178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:06.698814 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:39:06.752697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:06.753305 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:06.759126 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:06.759573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:06.760336 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:06.760781 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:06.778389 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9204db21-c579-4452-b5fb-21c54202619b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "DELETE /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 204 len: 0 microversion: 2.1 time: 0.117226 Oct 29 13:39:06.779068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 499/1025] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:39:06 2021] DELETE /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:39:06.788773 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:06.789475 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:06.795253 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:06.795695 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:06.796462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:06.796891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:06.884983 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:06.893236 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a7ee73fa-1b1b-4806-8f27-e5fa81f6f97d tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.144832 Oct 29 13:39:06.893838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 527/1026] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:06 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:06.917540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:06.924784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-512461da-c629-4fb0-ba82-56065199976a tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1574 microversion: 2.1 time: 0.141015 Oct 29 13:39:06.925343 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 500/1027] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:06 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1574 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:07.909966 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:07.910567 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:07.916697 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:07.917129 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:07.917895 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:07.918320 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:07.941861 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:07.942462 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:07.948084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:07.948525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:07.949280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:07.949705 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:08.047639 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:08.056224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-39db58f9-79cb-4b79-b326-c0f1499dbcc9 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.149819 Oct 29 13:39:08.057079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 528/1028] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:07 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:08.075316 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:08.082453 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-de183051-7d51-4ddd-a2a4-0ccbc1e557de tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1574 microversion: 2.1 time: 0.144136 Oct 29 13:39:08.083006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 501/1029] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:07 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:08.635131 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:08.635616 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:08.641408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:08.641883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:08.642648 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:08.643075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:08.656096 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] HTTP exception thrown: Instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 could not be found. Oct 29 13:39:08.656682 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Returning 404 to user: Instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:08.657495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2bc61457-a042-4e91-b38a-b6857f721ec6 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 404 len: 111 microversion: 2.1 time: 0.026005 Oct 29 13:39:08.658049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 529/1030] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:39:08 2021] DELETE /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:08.666280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:08.666824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:08.672527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:08.672975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:08.673739 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:08.674198 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:08.687685 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] HTTP exception thrown: Instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 could not be found. Oct 29 13:39:08.688266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Returning 404 to user: Instance ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:08.689084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3138b69f-0b9b-4bd9-bb47-e6d60d44e48c tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4" status: 404 len: 111 microversion: 2.1 time: 0.026489 Oct 29 13:39:08.689615 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 502/1031] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:08 2021] GET /compute/v2.1/servers/ebf1c3ca-c3d2-44a2-885c-b0012eadd5a4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:09.072769 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:09.073376 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:09.079213 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:09.079657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:09.080416 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:09.080842 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:09.099390 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:09.100183 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:09.106011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:09.106747 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:09.107595 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:09.108126 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:09.189111 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:09.198878 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b5998844-0d95-4764-9edf-7fcb92e67438 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 200 len: 1507 microversion: 2.1 time: 0.103243 Oct 29 13:39:09.200400 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 503/1032] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:09 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 1507 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:09.215211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:09.224428 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a30dc482-7ded-4075-8175-81c5db02da75 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.155192 Oct 29 13:39:09.225067 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-e0fe23dc-0088-43df-b358-17266ba0dc38 req-72f819d1-4673-481d-a3d0-8dd634056e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e312109a-5d7f-40b7-a0f4-c652d210410a", "name": "network-vif-deleted", "tag": "49fbc446-11dd-43aa-9ae2-5fca88cbf195"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:09.226055 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 530/1033] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:09 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:09.227646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:09.227646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:39:09.243039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e0fe23dc-0088-43df-b358-17266ba0dc38 req-72f819d1-4673-481d-a3d0-8dd634056e7b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:09.243504 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-e0fe23dc-0088-43df-b358-17266ba0dc38 req-72f819d1-4673-481d-a3d0-8dd634056e7b service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:09.257531 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-e0fe23dc-0088-43df-b358-17266ba0dc38 req-72f819d1-4673-481d-a3d0-8dd634056e7b service nova] Creating event network-vif-deleted:49fbc446-11dd-43aa-9ae2-5fca88cbf195 for instance e312109a-5d7f-40b7-a0f4-c652d210410a on hv-cinder-81588 Oct 29 13:39:09.269923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-e0fe23dc-0088-43df-b358-17266ba0dc38 req-72f819d1-4673-481d-a3d0-8dd634056e7b service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048294 Oct 29 13:39:09.270885 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 504/1034] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:09.999490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:10.000254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:10.006568 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.007013 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.007779 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.008208 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.021448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] HTTP exception thrown: Instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 could not be found. Oct 29 13:39:10.021988 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Returning 404 to user: Instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:10.022797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9e65982e-6f42-466c-959f-d459ca2b2d75 tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "DELETE /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 404 len: 111 microversion: 2.1 time: 0.027503 Oct 29 13:39:10.023317 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 531/1035] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:39:09 2021] DELETE /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:10.031732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:10.032453 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] [instance: 3514ebdc-efef-4212-a080-cb9e0f9c7cc4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:10.038434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.038883 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.039672 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.040082 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.054444 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] HTTP exception thrown: Instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 could not be found. Oct 29 13:39:10.055034 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] Returning 404 to user: Instance 3514ebdc-efef-4212-a080-cb9e0f9c7cc4 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:10.055863 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a2b070c2-baf5-484b-bde8-b7bd9678528a tempest-AttachVolumeTestJSON-1021441250 tempest-AttachVolumeTestJSON-1021441250-project] 10.222.0.96 "GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4" status: 404 len: 111 microversion: 2.1 time: 0.028211 Oct 29 13:39:10.056399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 505/1036] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:10 2021] GET /compute/v2.1/servers/3514ebdc-efef-4212-a080-cb9e0f9c7cc4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:10.216424 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:10.217021 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:10.223578 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.224552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.225321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.225744 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.240079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] HTTP exception thrown: Instance e312109a-5d7f-40b7-a0f4-c652d210410a could not be found. Oct 29 13:39:10.241116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Returning 404 to user: Instance e312109a-5d7f-40b7-a0f4-c652d210410a could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:10.241966 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:10.242441 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ef391852-b760-4256-83eb-5b8e5558de79 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 404 len: 111 microversion: 2.1 time: 0.029625 Oct 29 13:39:10.242566 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:10.249485 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.250541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.251355 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 532/1037] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:10 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:10.251625 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:10.252053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:10.363143 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1629024469", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-36819492", "security_groups": [{"name": "tempest-secgroup-smoke-255641277"}], "block_device_mapping_v2": [{"uuid": "16d5cacd-ff3d-4019-b732-007f566ccf92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d620a326-cd97-4595-b325-2f417240582b"}]}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:10.389094 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:10.398410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4f64661d-13d6-4243-91df-b9853eed3c9b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.160352 Oct 29 13:39:10.401821 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 506/1038] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:10 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:10.502120 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.network.neutron [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] validate_networks() for [('d620a326-cd97-4595-b325-2f417240582b', None, None, None, None, None)] {{(pid=122215) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:39:11.365573 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Flavor limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:39:11.366165 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Image limits 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:39:11.366492 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Flavor pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:39:11.367083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Image pref 0:0:0 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:39:11.367490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.virt.hardware [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122215) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:39:11.376211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:11.376653 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:11.377443 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:11.377898 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:11.393651 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for project dda9cf39e3ff4797af5227f990f14457. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:39:11.398026 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.quota [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for user a1c8d9c5df1a447ea666d48b3a35ec96 and project dda9cf39e3ff4797af5227f990f14457. Resources: {'ram', 'cores', 'instances'} {{(pid=122215) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:39:11.415978 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:11.416814 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:11.423530 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:11.424124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:11.424910 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:11.425410 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:11.461222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Going to run 1 instances... {{(pid=122215) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:39:11.463450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16d5cacd-ff3d-4019-b732-007f566ccf92',volume_size=None,volume_type=None)] {{(pid=122215) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:39:11.562272 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:11.571103 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-218a4023-95bc-4dbb-affd-69c584059e86 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.159220 Oct 29 13:39:11.571887 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 507/1039] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:11 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:11.598647 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-eb160ff8-79da-4029-8dde-a09d340e67b0 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.240093 Oct 29 13:39:11.600200 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 533/1040] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:39:10 2021] POST /compute/v2.1/servers => generated 405 bytes in 1242 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 29 13:39:11.609833 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0f76a27e-0f09-494e-ba02-a90d640fc721 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:11.610663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0f76a27e-0f09-494e-ba02-a90d640fc721 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:11.663891 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0f76a27e-0f09-494e-ba02-a90d640fc721 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:11.671360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0f76a27e-0f09-494e-ba02-a90d640fc721 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1093 microversion: 2.1 time: 0.065048 Oct 29 13:39:11.673144 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 508/1041] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:11 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:12.589378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:12.590820 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:12.598773 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:12.599536 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:12.600692 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:12.601610 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:12.688715 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:12.690465 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:12.698454 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:12.699173 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:12.700881 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:12.701527 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:12.788029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:12.797524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-23a3a5a3-a2d7-4317-a4c2-9dddaf58bf9b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1209 microversion: 2.1 time: 0.112035 Oct 29 13:39:12.798211 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 509/1042] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:12 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1209 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:13.032042 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:13.040792 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0972ecec-e228-411f-b00d-1abc20065ecc tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.455845 Oct 29 13:39:13.041368 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 534/1043] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:12 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:13.815391 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:13.816006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:13.824069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:13.824731 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:13.825556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:13.826031 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:14.060098 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:14.061105 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:14.067275 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:14.068438 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:14.069206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:14.069335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:14.069939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:14.080191 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6c24e979-442c-4c75-8560-3801d06b9954 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.268574 Oct 29 13:39:14.081554 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 510/1044] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:13 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:14.363306 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:14.376566 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c9c514d9-4720-472f-af72-3e0a3b3e5fb4 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1755 microversion: 2.1 time: 0.320473 Oct 29 13:39:14.377869 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 535/1045] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:14 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1755 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:14.404352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-71acbce5-826a-4cda-a73f-10f47a04fc71 req-65bc2f9c-75cf-481f-9e23-0060ec53ee23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7753d2e-eb91-4518-a32a-9c3b4ec957b0", "tag": "c8f3ee5d-4cf0-44ec-9150-c8bf02913da9"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:14.406932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:14.406932 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:39:14.417937 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-71acbce5-826a-4cda-a73f-10f47a04fc71 req-65bc2f9c-75cf-481f-9e23-0060ec53ee23 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:14.418943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-71acbce5-826a-4cda-a73f-10f47a04fc71 req-65bc2f9c-75cf-481f-9e23-0060ec53ee23 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:14.441666 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-71acbce5-826a-4cda-a73f-10f47a04fc71 req-65bc2f9c-75cf-481f-9e23-0060ec53ee23 service nova] Creating event network-changed:c8f3ee5d-4cf0-44ec-9150-c8bf02913da9 for instance e7753d2e-eb91-4518-a32a-9c3b4ec957b0 on hv-cinder-81588 Oct 29 13:39:14.449324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-71acbce5-826a-4cda-a73f-10f47a04fc71 req-65bc2f9c-75cf-481f-9e23-0060ec53ee23 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050321 Oct 29 13:39:14.450371 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 511/1046] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:39:15.098918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:15.099460 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:15.105307 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:15.105765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:15.106569 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:15.107006 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:15.242418 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:15.250102 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-89779df0-ec7e-4bab-96bc-d398d8bd0dc5 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.154933 Oct 29 13:39:15.251019 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 536/1047] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:15 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:15.395228 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:15.396033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:15.402319 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:15.402767 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:15.403678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:15.404115 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:15.605953 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:15.613930 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-da962c11-8f0d-49a7-b466-1bca031f6301 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1758 microversion: 2.1 time: 0.223037 Oct 29 13:39:15.615301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 512/1048] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:15 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:16.267128 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:16.267728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:16.274082 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:16.274522 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:16.275285 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:16.275709 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:16.403354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:16.406520 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-4563144b-4dd6-4725-813b-810c79892775 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.142961 Oct 29 13:39:16.407072 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 537/1049] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:16 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:17.422608 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:17.423213 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:17.429334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:17.429796 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:17.430564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:17.430995 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:17.626499 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:17.634118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a2b879d0-93bb-48c4-9c49-50164595ff21 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.215103 Oct 29 13:39:17.634894 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 513/1050] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:17 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:18.650563 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:18.651113 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:18.657334 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:18.657797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:18.658568 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:18.658997 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:18.780486 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:18.789290 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-94b8158d-6ba7-4290-a076-cd49e2532e84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.142394 Oct 29 13:39:18.789884 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 538/1051] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:18 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:19.806420 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:19.807033 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:19.812854 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:19.813298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:19.814087 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:19.814717 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:19.934553 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:19.941804 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-19b31ba2-10ac-45d7-8b05-be0433679fad tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.139024 Oct 29 13:39:19.942439 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 514/1052] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:19 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:20.959298 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:20.959833 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:20.965540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:20.966022 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:20.966790 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:20.967222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:21.083514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:21.090629 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-206c9376-32bd-48dd-bd41-7ea3cc625eca tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.135640 Oct 29 13:39:21.091191 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 539/1053] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:20 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:22.106352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:22.106963 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:22.112920 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:22.113364 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:22.114161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:22.114593 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:22.230573 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:22.237758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-53c72b6c-39f5-4b24-b485-9acc351af72c tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.135123 Oct 29 13:39:22.238344 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 515/1054] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:22 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:23.253816 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:23.254418 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:23.260268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:23.260722 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:23.261493 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:23.261961 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:23.383459 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:23.390848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b9e0b5a2-60e4-430f-a07c-c6b5f96dc9fe tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.140932 Oct 29 13:39:23.391462 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 540/1055] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:23 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:24.407690 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:24.408406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:24.414436 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:24.414962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:24.415867 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:24.416396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:24.539806 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:24.546997 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ceb36acf-8952-42c8-bff1-73270c3ee455 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.142912 Oct 29 13:39:24.547625 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 516/1056] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:24 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:25.563822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:25.564427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:25.570557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:25.571003 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:25.571764 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:25.572199 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:25.688531 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:25.695629 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-feb8bd17-74c8-4001-a02d-82b887def38d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.135448 Oct 29 13:39:25.696185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 541/1057] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:25 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:26.293080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-6b988d18-848d-4e3b-9198-cedb8c2d0a2a req-4c37e273-9075-40aa-abbd-96158d05857c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7753d2e-eb91-4518-a32a-9c3b4ec957b0", "name": "network-vif-plugged", "status": "completed", "tag": "c8f3ee5d-4cf0-44ec-9150-c8bf02913da9"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:26.295280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:26.295280 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:39:26.303078 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-6b988d18-848d-4e3b-9198-cedb8c2d0a2a req-4c37e273-9075-40aa-abbd-96158d05857c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:26.303665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-6b988d18-848d-4e3b-9198-cedb8c2d0a2a req-4c37e273-9075-40aa-abbd-96158d05857c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:26.320594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-6b988d18-848d-4e3b-9198-cedb8c2d0a2a req-4c37e273-9075-40aa-abbd-96158d05857c service nova] Creating event network-vif-plugged:c8f3ee5d-4cf0-44ec-9150-c8bf02913da9 for instance e7753d2e-eb91-4518-a32a-9c3b4ec957b0 on hv-cinder-81588 Oct 29 13:39:26.327077 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-6b988d18-848d-4e3b-9198-cedb8c2d0a2a req-4c37e273-9075-40aa-abbd-96158d05857c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037450 Oct 29 13:39:26.327923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 517/1058] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:39:26.711047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:26.711655 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:26.717323 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:26.717781 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:26.718557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:26.718986 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:26.881354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:26.889180 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-ec598a85-aa80-430b-9582-bf7410ba5f23 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1264 microversion: 2.1 time: 0.181662 Oct 29 13:39:26.889971 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 542/1059] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:26 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:27.908268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:27.908984 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:27.915791 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:27.916243 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:27.917002 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:27.917438 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:28.140901 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:28.159032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6f278f25-a309-4105-a747-6d428f8862cd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1451 microversion: 2.1 time: 0.253605 Oct 29 13:39:28.159868 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 518/1060] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:27 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1451 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:39:28.174998 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:28.175673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:28.181509 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:28.182062 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:28.183075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:28.183592 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:28.362506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:28.370234 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-0f904e36-73f6-42a5-a78c-bd53b81825b9 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1451 microversion: 2.1 time: 0.198864 Oct 29 13:39:28.370941 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 543/1061] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:28 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1451 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:30.217414 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-c9683c3a-e564-4280-83b5-0c087d464b77 req-0224167c-410c-4104-a67f-10cc4f7d1fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7753d2e-eb91-4518-a32a-9c3b4ec957b0", "tag": "c8f3ee5d-4cf0-44ec-9150-c8bf02913da9"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:30.219406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:30.219406 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:39:30.227604 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-c9683c3a-e564-4280-83b5-0c087d464b77 req-0224167c-410c-4104-a67f-10cc4f7d1fd3 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:30.228046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-c9683c3a-e564-4280-83b5-0c087d464b77 req-0224167c-410c-4104-a67f-10cc4f7d1fd3 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:30.239039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-c9683c3a-e564-4280-83b5-0c087d464b77 req-0224167c-410c-4104-a67f-10cc4f7d1fd3 service nova] Creating event network-changed:c8f3ee5d-4cf0-44ec-9150-c8bf02913da9 for instance e7753d2e-eb91-4518-a32a-9c3b4ec957b0 on hv-cinder-81588 Oct 29 13:39:30.243860 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-c9683c3a-e564-4280-83b5-0c087d464b77 req-0224167c-410c-4104-a67f-10cc4f7d1fd3 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030218 Oct 29 13:39:30.244691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 519/1062] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:43.536125 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e696dbe6-27db-48c4-94e5-82ab82ab84f6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:43.537069 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e696dbe6-27db-48c4-94e5-82ab82ab84f6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:43.542782 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e696dbe6-27db-48c4-94e5-82ab82ab84f6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:43.543223 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e696dbe6-27db-48c4-94e5-82ab82ab84f6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:43.543968 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e696dbe6-27db-48c4-94e5-82ab82ab84f6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:43.544392 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e696dbe6-27db-48c4-94e5-82ab82ab84f6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:43.572694 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e696dbe6-27db-48c4-94e5-82ab82ab84f6 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040501 Oct 29 13:39:43.573217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 544/1063] 10.222.0.96 () {60 vars in 1342 bytes} [Fri Oct 29 13:39:43 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:39:43.631768 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:43.632346 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:43.638351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:43.638792 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:43.639542 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:43.639968 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:43.663286 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:39:43.736685 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-585a5144-f688-4b28-a06d-b8e05f08331f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 204 len: 0 microversion: 2.20 time: 0.109015 Oct 29 13:39:43.737435 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 520/1064] 10.222.0.96 () {60 vars in 1279 bytes} [Fri Oct 29 13:39:43 2021] DELETE /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 13:39:43.745820 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:43.746418 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:43.752209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:43.752642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:43.753402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:43.753869 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:43.873157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:43.881378 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:43.882929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:43.884117 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c22e41ab-28a9-4359-a4c4-5aaa146aab6f tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.142065 Oct 29 13:39:43.884712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 545/1065] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:43 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:44.904737 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:44.905434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:44.911291 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:44.911784 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:44.912576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:44.913029 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:45.036257 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:45.044053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:45.045558 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:45.046832 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-919c3759-4cca-457b-a88c-cefe701b15c1 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1722 microversion: 2.20 time: 0.146190 Oct 29 13:39:45.047394 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 521/1066] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:44 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1722 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:46.067432 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:46.069209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:46.076236 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:46.076828 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:46.077631 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:46.078166 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:46.144619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-8963cca6-274f-422d-9e6e-affe2f773ad4 req-ea187454-326a-49c6-9982-c2f2b07c3bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9c9065a-62c0-4f58-82af-bd44e7a1ac45", "name": "network-vif-deleted", "tag": "207037ea-0c28-45f2-b0bb-bf243c80aa97"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:46.147539 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:46.147539 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:39:46.150540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:46.160666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:46.162394 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4e9e6a65d8804e74b5e939ed1d4be645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a7750e1de6f482ebcfe89e9ad577e0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:39:46.166646 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-8963cca6-274f-422d-9e6e-affe2f773ad4 req-ea187454-326a-49c6-9982-c2f2b07c3bd0 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:46.167136 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-8963cca6-274f-422d-9e6e-affe2f773ad4 req-ea187454-326a-49c6-9982-c2f2b07c3bd0 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:46.172757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-677ff635-1ac4-4472-8ca8-13b5593be74d tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 200 len: 1655 microversion: 2.20 time: 0.108811 Oct 29 13:39:46.186969 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 546/1067] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:46 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 1655 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 29 13:39:46.189187 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-8963cca6-274f-422d-9e6e-affe2f773ad4 req-ea187454-326a-49c6-9982-c2f2b07c3bd0 service nova] Creating event network-vif-deleted:207037ea-0c28-45f2-b0bb-bf243c80aa97 for instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 on hv-cinder-81588 Oct 29 13:39:46.201192 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-8963cca6-274f-422d-9e6e-affe2f773ad4 req-ea187454-326a-49c6-9982-c2f2b07c3bd0 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060506 Oct 29 13:39:46.201837 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 522/1068] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:39:47.191993 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:47.192603 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:47.198447 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:47.198891 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:47.199661 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:47.200094 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:47.214146 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] HTTP exception thrown: Instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 could not be found. Oct 29 13:39:47.214741 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Returning 404 to user: Instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:47.215566 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2defb841-6b12-4364-ab44-dd3a4ce584b2 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 404 len: 111 microversion: 2.20 time: 0.027183 Oct 29 13:39:47.216107 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 547/1069] 10.222.0.96 () {60 vars in 1276 bytes} [Fri Oct 29 13:39:47 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 29 13:39:47.225528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1b3b288d-1b7e-4645-8ac2-85a6ec1b4db5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '.version_select at 0x7f547c180940>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:47.245419 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1b3b288d-1b7e-4645-8ac2-85a6ec1b4db5 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327066438" status: 204 len: 0 microversion: 2.20 time: 0.024533 Oct 29 13:39:47.246146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 523/1070] 10.222.0.96 () {60 vars in 1258 bytes} [Fri Oct 29 13:39:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327066438 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 29 13:39:49.009921 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:49.010408 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:49.016044 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:49.016487 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:49.017245 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:49.017676 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:49.031058 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] HTTP exception thrown: Instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 could not be found. Oct 29 13:39:49.031632 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Returning 404 to user: Instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:49.032457 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-50eeb0aa-f759-430a-b5b6-466f6be78870 tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 404 len: 111 microversion: 2.1 time: 0.026293 Oct 29 13:39:49.032976 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 548/1071] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:39:49 2021] DELETE /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:49.041306 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:49.042204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: b9c9065a-62c0-4f58-82af-bd44e7a1ac45] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:49.048075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:49.048517 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:49.049283 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:49.049712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:49.064664 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] HTTP exception thrown: Instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 could not be found. Oct 29 13:39:49.065477 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Returning 404 to user: Instance b9c9065a-62c0-4f58-82af-bd44e7a1ac45 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:49.066479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b65fd444-ffb6-4d0e-a748-6936f51ca86e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45" status: 404 len: 111 microversion: 2.1 time: 0.028704 Oct 29 13:39:49.066849 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 524/1072] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:49 2021] GET /compute/v2.1/servers/b9c9065a-62c0-4f58-82af-bd44e7a1ac45 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:50.202886 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:50.203368 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:50.209477 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:50.209949 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:50.210693 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:50.211114 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:50.223704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] HTTP exception thrown: Instance 27c9284f-a335-4a48-9c8b-5e1572d12240 could not be found. Oct 29 13:39:50.224866 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Returning 404 to user: Instance 27c9284f-a335-4a48-9c8b-5e1572d12240 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:50.225642 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-47b4dd34-0517-43f5-9e4f-10ed9dee11dc tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "DELETE /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 404 len: 111 microversion: 2.1 time: 0.026359 Oct 29 13:39:50.226165 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 549/1073] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:39:50 2021] DELETE /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:50.233712 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:50.234293 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] [instance: 27c9284f-a335-4a48-9c8b-5e1572d12240] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:50.239945 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:50.240394 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:50.241154 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:50.241668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:50.254591 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] HTTP exception thrown: Instance 27c9284f-a335-4a48-9c8b-5e1572d12240 could not be found. Oct 29 13:39:50.255198 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] Returning 404 to user: Instance 27c9284f-a335-4a48-9c8b-5e1572d12240 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:39:50.256011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-accd7c55-d68a-4aef-ad95-ca24b943907e tempest-AttachVolumeShelveTestJSON-279097635 tempest-AttachVolumeShelveTestJSON-279097635-project] 10.222.0.96 "GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240" status: 404 len: 111 microversion: 2.1 time: 0.026043 Oct 29 13:39:50.256525 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 525/1074] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:39:50 2021] GET /compute/v2.1/servers/27c9284f-a335-4a48-9c8b-5e1572d12240 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:39:54.299663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2108735566"}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:54.300288 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:54.306157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:54.306621 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:54.307469 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:54.307888 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:54.430342 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.network.security_group_api [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Removing security group 31c31add-f029-4a31-90ed-b8e46ee3a507 from port a6f1c1d1-b296-47fe-861a-d306e40696a7 Oct 29 13:39:54.782078 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b63ecfd4-5f6e-4a4f-946b-2434cf10fae8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/action" status: 202 len: 0 microversion: 2.1 time: 0.485929 Oct 29 13:39:54.783091 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 550/1075] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:39:54 2021] POST /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:39:54.795503 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-fd38f9c0-7419-4844-b7a6-00186f84d7fe req-73ef2339-008a-40c1-b563-d7d090491af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471017e8-2ba0-4199-9c0a-732ae35252f4", "tag": "a6f1c1d1-b296-47fe-861a-d306e40696a7"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:54.797957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:54.797957 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:39:54.811475 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-fd38f9c0-7419-4844-b7a6-00186f84d7fe req-73ef2339-008a-40c1-b563-d7d090491af1 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:54.812132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-fd38f9c0-7419-4844-b7a6-00186f84d7fe req-73ef2339-008a-40c1-b563-d7d090491af1 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:54.836247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-fd38f9c0-7419-4844-b7a6-00186f84d7fe req-73ef2339-008a-40c1-b563-d7d090491af1 service nova] Creating event network-changed:a6f1c1d1-b296-47fe-861a-d306e40696a7 for instance 471017e8-2ba0-4199-9c0a-732ae35252f4 on hv-cinder-81588 Oct 29 13:39:54.841810 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-fd38f9c0-7419-4844-b7a6-00186f84d7fe req-73ef2339-008a-40c1-b563-d7d090491af1 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051510 Oct 29 13:39:54.842790 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 526/1076] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:56.566956 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:56.567975 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:56.573846 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:56.574297 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:56.575060 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:56.575495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:56.662738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lazy-loading 'services' on Instance uuid 471017e8-2ba0-4199-9c0a-732ae35252f4 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:39:56.732565 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-099789ee-8bbb-485a-b2f3-615159fa9f90 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments/293bdefd-0cc4-4c04-a45f-7dcf0eb3fce5" status: 202 len: 0 microversion: 2.1 time: 0.169253 Oct 29 13:39:56.733757 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 551/1077] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:39:56 2021] DELETE /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments/293bdefd-0cc4-4c04-a45f-7dcf0eb3fce5 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:39:56.744873 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8d7ee004-6278-4ec6-851e-38f8cfbfb020 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:56.749108 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8d7ee004-6278-4ec6-851e-38f8cfbfb020 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:56.760615 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d7ee004-6278-4ec6-851e-38f8cfbfb020 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:56.761050 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d7ee004-6278-4ec6-851e-38f8cfbfb020 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:56.762564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d7ee004-6278-4ec6-851e-38f8cfbfb020 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:56.763294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8d7ee004-6278-4ec6-851e-38f8cfbfb020 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:56.807302 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8d7ee004-6278-4ec6-851e-38f8cfbfb020 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067868 Oct 29 13:39:56.807972 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 527/1078] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:39:56 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:56.862480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-d3402b18-5c3d-4e54-8697-fa73a6c382a7 req-17305baa-a6b3-4473-b713-cbf8f895d219 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "471017e8-2ba0-4199-9c0a-732ae35252f4", "tag": "a6f1c1d1-b296-47fe-861a-d306e40696a7"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:39:56.865057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:39:56.865057 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:39:56.873193 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-d3402b18-5c3d-4e54-8697-fa73a6c382a7 req-17305baa-a6b3-4473-b713-cbf8f895d219 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:56.874050 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-d3402b18-5c3d-4e54-8697-fa73a6c382a7 req-17305baa-a6b3-4473-b713-cbf8f895d219 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:56.892309 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-d3402b18-5c3d-4e54-8697-fa73a6c382a7 req-17305baa-a6b3-4473-b713-cbf8f895d219 service nova] Creating event network-changed:a6f1c1d1-b296-47fe-861a-d306e40696a7 for instance 471017e8-2ba0-4199-9c0a-732ae35252f4 on hv-cinder-81588 Oct 29 13:39:56.898952 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-d3402b18-5c3d-4e54-8697-fa73a6c382a7 req-17305baa-a6b3-4473-b713-cbf8f895d219 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041441 Oct 29 13:39:56.899858 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 552/1079] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:39:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:57.819696 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a4be5927-7331-46ea-8015-d2b7652d56c7 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:57.820520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a4be5927-7331-46ea-8015-d2b7652d56c7 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:57.826471 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a4be5927-7331-46ea-8015-d2b7652d56c7 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:57.826919 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a4be5927-7331-46ea-8015-d2b7652d56c7 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:57.827684 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a4be5927-7331-46ea-8015-d2b7652d56c7 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:57.828124 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a4be5927-7331-46ea-8015-d2b7652d56c7 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:57.857631 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a4be5927-7331-46ea-8015-d2b7652d56c7 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042581 Oct 29 13:39:57.858348 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 528/1080] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:39:57 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:58.870231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7796f863-96dd-484c-bc2f-d2848d684c01 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:58.871224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7796f863-96dd-484c-bc2f-d2848d684c01 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:58.877569 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7796f863-96dd-484c-bc2f-d2848d684c01 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:58.878034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7796f863-96dd-484c-bc2f-d2848d684c01 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:58.878805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7796f863-96dd-484c-bc2f-d2848d684c01 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:58.879235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7796f863-96dd-484c-bc2f-d2848d684c01 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:58.907072 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7796f863-96dd-484c-bc2f-d2848d684c01 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040939 Oct 29 13:39:58.907819 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 553/1081] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:39:58 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:39:59.918365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-1cc65e68-30d0-4f65-8beb-655a2ff33eb1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:39:59.919295 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-1cc65e68-30d0-4f65-8beb-655a2ff33eb1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:39:59.925282 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1cc65e68-30d0-4f65-8beb-655a2ff33eb1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:59.925556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1cc65e68-30d0-4f65-8beb-655a2ff33eb1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:59.926361 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1cc65e68-30d0-4f65-8beb-655a2ff33eb1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:39:59.927381 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-1cc65e68-30d0-4f65-8beb-655a2ff33eb1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:39:59.955882 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-1cc65e68-30d0-4f65-8beb-655a2ff33eb1 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041224 Oct 29 13:39:59.956623 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 529/1082] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:39:59 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:40:00.967915 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6dbd503f-9c9e-4d1a-9b96-940ae9549ff0 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:00.968821 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6dbd503f-9c9e-4d1a-9b96-940ae9549ff0 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:00.975062 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6dbd503f-9c9e-4d1a-9b96-940ae9549ff0 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:00.975948 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6dbd503f-9c9e-4d1a-9b96-940ae9549ff0 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:00.976441 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6dbd503f-9c9e-4d1a-9b96-940ae9549ff0 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:00.976916 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6dbd503f-9c9e-4d1a-9b96-940ae9549ff0 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:01.007792 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6dbd503f-9c9e-4d1a-9b96-940ae9549ff0 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043795 Oct 29 13:40:01.012997 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 554/1083] 10.222.0.96 () {58 vars in 1301 bytes} [Fri Oct 29 13:40:00 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 29 13:40:01.019848 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:01.020434 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:01.026383 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:01.026982 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:01.027813 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:01.028247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:01.111360 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] HTTP exception thrown: Instance 471017e8-2ba0-4199-9c0a-732ae35252f4 is not attached to volume 293bdefd-0cc4-4c04-a45f-7dcf0eb3fce5 Oct 29 13:40:01.111973 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Returning 404 to user: Instance 471017e8-2ba0-4199-9c0a-732ae35252f4 is not attached to volume 293bdefd-0cc4-4c04-a45f-7dcf0eb3fce5 {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:40:01.112928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-13587e1f-2ad9-4785-af8d-0d1959090787 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments/293bdefd-0cc4-4c04-a45f-7dcf0eb3fce5" status: 404 len: 154 microversion: 2.1 time: 0.098453 Oct 29 13:40:01.113351 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 530/1084] 10.222.0.96 () {58 vars in 1415 bytes} [Fri Oct 29 13:40:01 2021] DELETE /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4/os-volume_attachments/293bdefd-0cc4-4c04-a45f-7dcf0eb3fce5 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:40:02.249546 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:02.250098 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:02.256070 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:02.256514 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:02.257274 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:02.257704 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:02.281139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:40:02.356794 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1b2f8fc7-9ac4-4203-a559-4d3f23d61c6f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "DELETE /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 204 len: 0 microversion: 2.1 time: 0.110257 Oct 29 13:40:02.357445 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 555/1085] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:40:02 2021] DELETE /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:40:02.365579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:02.366486 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:02.372620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:02.373132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:02.374084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:02.374582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:02.501123 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:02.508852 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-97d5c436-8dc6-4ba5-8d63-23d8514aa52f tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1554 microversion: 2.1 time: 0.147023 Oct 29 13:40:02.509409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 531/1086] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:02 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:03.526495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:03.527207 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:03.533117 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:03.533559 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:03.534356 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:03.534790 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:03.653534 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:03.661034 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-75999b8c-4da4-4329-b059-f23846daf1fe tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1554 microversion: 2.1 time: 0.138848 Oct 29 13:40:03.661589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 556/1087] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:03 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1554 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:40:04.677231 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:04.678301 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:04.684094 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:04.684540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:04.685294 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:04.685732 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:04.802334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:04.810762 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8ddaf05b-c8c6-41b3-be73-bf8411081a46 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1554 microversion: 2.1 time: 0.137090 Oct 29 13:40:04.811324 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 532/1088] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:04 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1554 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:05.829341 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:05.829978 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:05.835765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:05.836213 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:05.836973 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:05.837403 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:05.956992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:05.964738 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cbb1f9e1-ecfa-43bb-9f04-67ccab6b64d8 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1554 microversion: 2.1 time: 0.139138 Oct 29 13:40:05.965296 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 557/1089] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:05 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1554 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:06.982423 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:06.982943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:06.989240 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:06.989683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:06.990484 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:06.991097 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:07.181506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:07.188971 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-06fb1f67-e303-41c4-8680-10214980ada3 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1554 microversion: 2.1 time: 0.211082 Oct 29 13:40:07.189481 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 533/1090] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:06 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:07.306259 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-8f7955c5-b284-4d94-8ba5-494f41123a0b req-e054a418-b054-4d37-9298-7ec49e41d696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "471017e8-2ba0-4199-9c0a-732ae35252f4", "name": "network-vif-deleted", "tag": "a6f1c1d1-b296-47fe-861a-d306e40696a7"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:40:07.307985 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:40:07.307985 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:40:07.315917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-8f7955c5-b284-4d94-8ba5-494f41123a0b req-e054a418-b054-4d37-9298-7ec49e41d696 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:07.316362 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-8f7955c5-b284-4d94-8ba5-494f41123a0b req-e054a418-b054-4d37-9298-7ec49e41d696 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:07.327476 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-8f7955c5-b284-4d94-8ba5-494f41123a0b req-e054a418-b054-4d37-9298-7ec49e41d696 service nova] Creating event network-vif-deleted:a6f1c1d1-b296-47fe-861a-d306e40696a7 for instance 471017e8-2ba0-4199-9c0a-732ae35252f4 on hv-cinder-81588 Oct 29 13:40:07.332437 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-8f7955c5-b284-4d94-8ba5-494f41123a0b req-e054a418-b054-4d37-9298-7ec49e41d696 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030169 Oct 29 13:40:07.333011 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 558/1091] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:40:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:40:08.206053 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:08.206857 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:08.212924 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:08.213365 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:08.214149 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:08.214641 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:08.272773 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:08.279946 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-ae114d79-5f04-4147-aced-2f2ee67e268e tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1512 microversion: 2.1 time: 0.077506 Oct 29 13:40:08.280503 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 534/1092] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:08 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1512 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:09.297863 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:09.298617 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:09.305239 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:09.305685 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:09.306471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:09.306904 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:09.364319 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:09.372593 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c04f84d4-fb3d-4b4d-b19a-667dbbb2b78c tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1343 microversion: 2.1 time: 0.078779 Oct 29 13:40:09.373149 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 559/1093] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:09 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1343 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:10.389342 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:10.390001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:10.395739 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:10.396814 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:10.397580 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:10.398032 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:10.456628 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d0e2de38d904112802ef3d3c04c5c44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ec7253bb7c24dabb6c7b2841791c547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:10.463970 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f415496d-1e8d-46d2-b124-35e35909ee65 tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 200 len: 1343 microversion: 2.1 time: 0.078205 Oct 29 13:40:10.464731 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 535/1094] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:10 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 1343 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:11.481196 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:11.481812 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] [instance: 471017e8-2ba0-4199-9c0a-732ae35252f4] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:11.487448 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:11.487880 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:11.488626 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:11.489046 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:11.502353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] HTTP exception thrown: Instance 471017e8-2ba0-4199-9c0a-732ae35252f4 could not be found. Oct 29 13:40:11.502926 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Returning 404 to user: Instance 471017e8-2ba0-4199-9c0a-732ae35252f4 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:40:11.503721 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2f8a1599-aa69-40a5-9106-c1471c42401a tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4" status: 404 len: 111 microversion: 2.1 time: 0.026202 Oct 29 13:40:11.504235 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 560/1095] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:11 2021] GET /compute/v2.1/servers/471017e8-2ba0-4199-9c0a-732ae35252f4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:40:11.512099 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e3a9f8b8-907f-4382-a097-bb2198c2226b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] Calling method '.version_select at 0x7f547c214e50>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:11.530794 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e3a9f8b8-907f-4382-a097-bb2198c2226b tempest-TestMinimumBasicScenario-979014690 tempest-TestMinimumBasicScenario-979014690-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-373014422" status: 202 len: 0 microversion: 2.1 time: 0.022299 Oct 29 13:40:11.531483 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 536/1096] 10.222.0.96 () {58 vars in 1268 bytes} [Fri Oct 29 13:40:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-373014422 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:40:17.867806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:40:17.868461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:17.875114 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:17.875922 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:17.876710 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:17.877139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:17.921678 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lazy-loading 'flavor' on Instance uuid ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:40:18.000759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-728e71b3-8065-45a6-8161-2bad6c500ffa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "POST /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.137337 Oct 29 13:40:18.001449 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 561/1097] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:40:17 2021] POST /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:40:18.010471 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:18.011636 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:18.019020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:18.020026 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:18.022102 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:18.023902 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:18.213426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:18.221338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-446de623-e99a-4a50-a956-ebcd822add74 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.215402 Oct 29 13:40:18.222314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 537/1098] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:18 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:19.238759 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:19.239455 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:19.245321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:19.245797 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:19.246569 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:19.247004 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:19.371680 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:19.379972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dc77000f-858e-435d-ac03-786403c23d03 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.145044 Oct 29 13:40:19.381252 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 562/1099] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:19 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:20.398084 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:20.398724 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:20.404585 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:20.405030 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:20.405810 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:20.406244 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:20.522409 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:20.529587 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e1638904-5ecb-4a1a-b288-00d82f62d6c6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.135685 Oct 29 13:40:20.530183 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 538/1100] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:20 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:21.547002 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:21.547537 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:21.553230 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:21.553666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:21.554438 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:21.554859 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:21.671022 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:21.678693 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-97803296-ad9f-4c72-930c-2cf9521676cd tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.135516 Oct 29 13:40:21.679254 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 563/1101] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:21 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:22.696407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:22.697018 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:22.702722 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:22.703169 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:22.703931 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:22.704363 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:22.827112 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:22.835441 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-c2d4624f-d8c1-4a09-8e5f-654e9923c0a0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.144182 Oct 29 13:40:22.836015 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 539/1102] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:22 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:23.852547 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:23.853148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:23.858922 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:23.859369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:23.860124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:23.860552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:23.979978 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:23.987271 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-78a80b8f-3b3e-46ea-9027-ea9091554299 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.138833 Oct 29 13:40:23.988001 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 564/1103] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:23 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:25.003905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:25.004450 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:25.010174 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:25.010619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:25.011381 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:25.011814 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:25.129151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:25.137146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-2fb58b34-71e3-476a-b0d6-a2fb36607d52 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.137171 Oct 29 13:40:25.137956 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 540/1104] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:24 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:26.154351 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:26.154939 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:26.160491 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:26.160935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:26.161686 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:26.162139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:26.278663 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:26.285646 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-c6796ca8-b155-462b-ad69-44f2ecf04f00 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.135010 Oct 29 13:40:26.286228 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 565/1105] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:26 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:27.302918 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:27.303679 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:27.309524 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:27.310013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:27.310783 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:27.311215 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:27.427578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:27.434770 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0d1fd500-900b-48ca-a649-407d855009d4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.135842 Oct 29 13:40:27.435334 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 541/1106] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:27 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:28.451691 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:28.452354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:28.458048 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:28.458543 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:28.459888 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:28.460377 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:28.581229 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:28.589557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-8714fa38-30e1-4473-a95e-a6b76ad2e3a3 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.141481 Oct 29 13:40:28.590162 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 566/1107] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:28 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:29.606620 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:29.607361 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:29.613276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:29.614001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:29.614771 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:29.615892 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:29.745869 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:29.766247 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cd906ce7-cb34-4493-b534-5947e1464f85 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.163168 Oct 29 13:40:29.766850 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 542/1108] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:29 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:30.783428 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:30.784173 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:30.792160 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:30.792999 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:30.794281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:30.794822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:30.921074 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:30.929190 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-704b3d9f-a445-4ae2-bbcb-99e22557a108 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.149207 Oct 29 13:40:30.929610 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 567/1109] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:30 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:31.953629 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:31.953629 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:31.953629 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:31.953629 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:31.954394 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:31.954828 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:32.084520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:32.092225 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cbc7641e-0cbc-436f-bc43-4122bd8690ed tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.149834 Oct 29 13:40:32.093189 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 543/1110] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:31 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:33.107892 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:33.108542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:33.114183 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:33.114624 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:33.116049 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:33.116492 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:33.241281 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:33.248680 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-74997230-d056-438f-9abf-ffe7e3f3b618 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.144369 Oct 29 13:40:33.249339 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 568/1111] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:33 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:34.266396 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:34.266931 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:34.273270 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:34.273933 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:34.274925 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:34.275118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:34.393581 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:34.401237 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f6ee914a-b21f-424a-b5d8-77540c42ed68 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.138584 Oct 29 13:40:34.401794 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 544/1112] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:34 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:35.416909 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:35.417611 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:35.423241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:35.423682 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:35.424433 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:35.424854 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:35.550333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:35.558540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-08c05572-01ac-4b99-809e-29228d62690d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.145222 Oct 29 13:40:35.559185 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 569/1113] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:35 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:40:36.575381 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:36.576013 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:36.582260 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:36.582421 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:36.583261 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:36.583700 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:36.703579 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:36.711655 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-31f0262e-61ad-4c0c-a12b-92d3d1d2d9ea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.139949 Oct 29 13:40:36.712222 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 545/1114] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:36 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:37.729450 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:37.732859 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:37.738614 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:37.739056 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:37.739820 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:37.740887 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:37.861863 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:37.869371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-abeb704d-183b-4eb9-a74e-8ecd12d34150 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.144611 Oct 29 13:40:37.869959 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 570/1115] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:37 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:38.886803 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:38.887494 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:38.893069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:38.893603 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:38.894464 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:38.894963 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:39.018089 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:39.025597 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-dd26f6c0-d77a-4fbd-9fde-7b8d61e458ad tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.142399 Oct 29 13:40:39.026190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 546/1116] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:38 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:40.042337 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:40.042972 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:40.048745 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:40.049198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:40.049991 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:40.050429 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:40.166495 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:40.173763 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-13c2a916-3346-4011-b4f2-082dd22d52c2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.135042 Oct 29 13:40:40.174929 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 571/1117] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:40 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:41.190733 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:41.191333 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:41.197533 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:41.198001 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:41.198782 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:41.199204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:41.319058 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:41.326358 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-8aa53416-3506-4a87-8652-6c342d6d499e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.139246 Oct 29 13:40:41.326921 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 547/1118] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:41 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:42.343568 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:42.344170 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:42.349917 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:42.350360 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:42.351116 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:42.351542 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:42.469885 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:42.477091 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fc84466b-c570-4dbc-b475-ce8b7d089c73 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.137135 Oct 29 13:40:42.477650 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 572/1119] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:42 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:43.493691 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:43.494271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:43.500211 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:43.500912 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:43.501665 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:43.502126 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:43.618946 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:43.626472 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-412c01ef-99d9-498e-8bf5-2db25fe99386 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.136539 Oct 29 13:40:43.627034 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 548/1120] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:43 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:44.643539 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:44.644142 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:44.650192 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:44.650639 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:44.651427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:44.651875 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:44.769385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:44.776589 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9723bd30-63f7-443a-836e-733e9a1e451c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.136646 Oct 29 13:40:44.777156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 573/1121] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:44 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:45.008263 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:40:45.008804 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: Fri Oct 29 13:40:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:40:45.793456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:45.795481 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:45.801233 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:45.801687 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:45.802650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:45.803093 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:45.924530 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:45.931786 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fb59ce5b-c215-4efc-9b79-5facd18cfe6e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.142007 Oct 29 13:40:45.932341 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 549/1122] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:45 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:40:46.948101 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:46.948702 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:46.954333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:46.954778 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:46.955673 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:46.956133 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:47.081698 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:47.089280 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-a1f0f892-bb18-4201-9485-64c69d7aba7c tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.144837 Oct 29 13:40:47.098174 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 574/1123] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:46 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:48.105520 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:48.106239 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:48.112281 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:48.112818 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:48.113589 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:48.114039 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:48.249645 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:48.258479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4747b49c-375f-49d7-bce8-2aae1d91a631 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.156406 Oct 29 13:40:48.259250 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 550/1124] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:48 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:49.276666 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:49.277390 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:49.283277 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:49.283722 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:49.284489 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:49.284920 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:49.411137 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:49.418388 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-fc23aaf4-dd56-4465-aca2-992ff1553200 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1508 microversion: 2.1 time: 0.146564 Oct 29 13:40:49.418952 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 575/1125] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:49 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:40:49.434512 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-525c9b70-314f-44fe-806c-b53770f8fb3e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:40:49.435079 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-525c9b70-314f-44fe-806c-b53770f8fb3e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:49.440711 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-525c9b70-314f-44fe-806c-b53770f8fb3e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:49.441153 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-525c9b70-314f-44fe-806c-b53770f8fb3e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:49.441943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-525c9b70-314f-44fe-806c-b53770f8fb3e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:49.442375 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-525c9b70-314f-44fe-806c-b53770f8fb3e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:49.516008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-525c9b70-314f-44fe-806c-b53770f8fb3e tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "POST /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1/action" status: 202 len: 0 microversion: 2.1 time: 0.085096 Oct 29 13:40:49.516598 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 551/1126] 10.222.0.96 () {60 vars in 1277 bytes} [Fri Oct 29 13:40:49 2021] POST /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:40:49.524426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:49.527767 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:49.533822 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:49.534260 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:49.535249 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:49.535725 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:49.675047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:49.683760 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3a72cfa6-0247-4700-b648-3ff1fcd64ace tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1516 microversion: 2.1 time: 0.162901 Oct 29 13:40:49.684463 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 576/1127] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:49 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:50.701738 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:50.702370 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:50.708107 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:50.708541 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:50.709286 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:50.709710 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:50.832278 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:50.840185 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-cfb82d43-0db8-4d30-a9af-9f94f7e0aa77 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1516 microversion: 2.1 time: 0.142159 Oct 29 13:40:50.840774 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 552/1128] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:50 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1516 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:51.857424 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:51.858061 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:51.863705 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:51.864139 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:51.864888 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:51.865318 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:51.987156 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:51.994920 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e9a4964a-6784-428d-86b6-f7e44598f74d tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1516 microversion: 2.1 time: 0.141124 Oct 29 13:40:51.995476 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 577/1129] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:51 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1516 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:52.958290 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-765328ce-62f3-4de4-b224-56159f25c223 req-b41880c8-b76b-491b-9c17-52a73600193f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1", "name": "network-vif-unplugged", "status": "completed", "tag": "1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:40:52.960133 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:40:52.960133 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:40:52.969254 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-765328ce-62f3-4de4-b224-56159f25c223 req-b41880c8-b76b-491b-9c17-52a73600193f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:52.970046 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-765328ce-62f3-4de4-b224-56159f25c223 req-b41880c8-b76b-491b-9c17-52a73600193f service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:52.984164 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.compute.server_external_events [req-765328ce-62f3-4de4-b224-56159f25c223 req-b41880c8-b76b-491b-9c17-52a73600193f service nova] Unable to find a host for instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1. Dropping event network-vif-unplugged {{(pid=122216) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Oct 29 13:40:52.985407 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-765328ce-62f3-4de4-b224-56159f25c223 req-b41880c8-b76b-491b-9c17-52a73600193f service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030988 Oct 29 13:40:52.986971 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 553/1130] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:40:52 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 29 13:40:53.012918 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:53.014278 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:53.020335 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:53.020785 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:53.021556 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:53.022050 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:53.140570 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:53.147782 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-318ed429-d346-44fd-8ca0-a47feb2dea92 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1518 microversion: 2.1 time: 0.138664 Oct 29 13:40:53.148882 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 578/1131] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:53 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1518 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:40:54.165228 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:54.165908 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:54.177393 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:54.177833 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:54.178640 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:54.179068 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:54.316551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:54.323805 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-60c4ccca-42a5-4d26-869e-f7ea7cb8b948 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.162263 Oct 29 13:40:54.324352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 554/1132] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:54 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:55.340595 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:55.341198 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:55.347166 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:55.347614 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:55.348379 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:55.348806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:55.471487 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:55.480174 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-50852c2e-41c1-4428-8707-11adfd5f7228 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.143072 Oct 29 13:40:55.486706 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 579/1133] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:55 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:56.496811 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:56.497440 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:56.503556 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:56.503999 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:56.504759 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:56.505190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:56.634772 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:56.642239 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-895d400d-edce-4b4d-8cb6-aa70eb43c284 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.149032 Oct 29 13:40:56.642802 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 555/1134] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:56 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:57.659224 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:57.659859 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:57.666464 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:57.666848 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:57.667628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:57.668047 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:57.784572 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:57.791991 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d2104bd2-b9a6-464e-8314-fd03b5a573e9 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.136676 Oct 29 13:40:57.792594 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 580/1135] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:57 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:58.809495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:58.810070 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:58.815991 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:58.816498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:58.817276 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:58.817756 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:58.941220 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:40:58.948668 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5cdf0e77-768d-455f-a98c-708619b1997f tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.143573 Oct 29 13:40:58.949234 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 556/1136] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:58 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:40:59.965385 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:40:59.966088 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:40:59.968547 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: ERROR oslo.messaging._drivers.impl_rabbit [-] [90352fb7-2767-4d6c-bee2-209b248251fd] AMQP server on 10.222.0.96:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 13:40:59.972913 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:59.973364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:40:59.974157 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:40:59.974590 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:00.091213 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:00.098470 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-6d2ce7d3-0a73-46a5-8d9a-c6c41470a135 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.136874 Oct 29 13:41:00.099035 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 581/1137] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:40:59 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:01.115121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:01.115726 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:01.122117 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:01.122564 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:01.123328 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:01.123755 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:01.238648 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:01.246416 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-6c5f5b41-8b7e-43ab-a1ff-3cc243cf5f37 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.134964 Oct 29 13:41:01.246976 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 557/1138] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:01 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:02.263163 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:02.263765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:02.279721 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:02.280108 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:02.280864 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:02.281293 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:02.286807 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO oslo.messaging._drivers.impl_rabbit [-] [90352fb7-2767-4d6c-bee2-209b248251fd] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 37998. Oct 29 13:41:02.402063 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:02.409288 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-afefb1b8-b893-4211-94e8-5eab1ebd0303 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.150346 Oct 29 13:41:02.409865 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 582/1139] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:02 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:03.425190 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:03.425743 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:03.432211 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:03.432662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:03.433426 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:03.433895 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:03.552863 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:03.560708 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f5c271f8-3141-4f04-a7bb-f0c6442eaab2 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.139212 Oct 29 13:41:03.561268 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 558/1140] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:03 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:04.577540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:04.578159 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:04.583809 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:04.584247 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:04.584993 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:04.585414 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:04.701161 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:04.708346 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9aa35769-afe2-4469-b1c4-e6c57a8a49a8 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.134480 Oct 29 13:41:04.708897 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 583/1141] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:04 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:05.724676 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:05.725284 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:05.731810 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:05.732256 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:05.733020 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:05.733454 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:05.851085 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:05.858674 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b270b4f9-db67-46d1-8ec2-6a30fd30b260 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.137685 Oct 29 13:41:05.859237 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 559/1142] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:05 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:06.875471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:06.876392 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:06.882195 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:06.882640 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:06.883402 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:06.883838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:07.001619 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:07.008959 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-dd7d502e-d491-4cf4-8c08-ba7a6bdaead6 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.137112 Oct 29 13:41:07.009557 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 584/1143] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:06 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:07.366902 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:41:07.367079 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: Fri Oct 29 13:41:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:41:08.026892 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:08.027495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:08.033356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:08.033824 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:08.034584 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:08.035004 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:08.152338 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:08.159575 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3cfd8b7f-96d4-4530-8b3f-51da020a811a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.136933 Oct 29 13:41:08.160132 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 560/1144] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:08 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:08.240268 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-9025e0af-0b35-48da-a368-1e858505c16d req-48816de5-c6ec-450b-b24b-7f9498ee7645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1", "name": "network-vif-plugged", "status": "completed", "tag": "1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:41:08.241823 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:41:08.241823 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:41:08.249231 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-9025e0af-0b35-48da-a368-1e858505c16d req-48816de5-c6ec-450b-b24b-7f9498ee7645 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:08.249717 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-9025e0af-0b35-48da-a368-1e858505c16d req-48816de5-c6ec-450b-b24b-7f9498ee7645 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:08.262354 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-9025e0af-0b35-48da-a368-1e858505c16d req-48816de5-c6ec-450b-b24b-7f9498ee7645 service nova] Creating event network-vif-plugged:1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2 for instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 on hv-cinder-81588 Oct 29 13:41:08.267260 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-9025e0af-0b35-48da-a368-1e858505c16d req-48816de5-c6ec-450b-b24b-7f9498ee7645 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030674 Oct 29 13:41:08.267836 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 585/1145] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:41:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:41:09.178478 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:09.179425 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:09.186559 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:09.186923 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:09.187836 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:09.188369 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:09.313470 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:09.320880 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-4ed9aabb-b424-458f-a018-765ba2fd622a tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1574 microversion: 2.1 time: 0.146194 Oct 29 13:41:09.322477 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 561/1146] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:09 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:10.338946 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:10.339765 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:10.345881 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:10.346331 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:10.347090 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:10.347521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:10.511876 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:10.519427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-2ca3ce47-d05f-418e-b5bc-cada2d1523f0 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1561 microversion: 2.1 time: 0.184942 Oct 29 13:41:10.520127 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 586/1147] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:10 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:32.981928 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-692698066", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-36819492", "security_groups": [{"name": "tempest-secgroup-smoke-255641277"}], "block_device_mapping_v2": [{"uuid": "c8454beb-9a8e-46c2-838c-2f35682e24a9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d620a326-cd97-4595-b325-2f417240582b"}]}} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:41:33.082350 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.network.neutron [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] validate_networks() for [('d620a326-cd97-4595-b325-2f417240582b', None, None, None, None, None)] {{(pid=122216) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Oct 29 13:41:33.439572 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Flavor limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 29 13:41:33.440011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Image limits 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 29 13:41:33.440473 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Flavor pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 29 13:41:33.440866 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Image pref 0:0:0 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 29 13:41:33.441266 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.virt.hardware [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122216) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 29 13:41:33.449880 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:33.450317 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:33.451104 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:33.451526 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:33.467528 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for project dda9cf39e3ff4797af5227f990f14457. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:387}} Oct 29 13:41:33.471418 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.quota [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Getting quotas for user a1c8d9c5df1a447ea666d48b3a35ec96 and project dda9cf39e3ff4797af5227f990f14457. Resources: {'ram', 'cores', 'instances'} {{(pid=122216) _get_quotas /opt/stack/nova/nova/quota.py:377}} Oct 29 13:41:33.530151 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Going to run 1 instances... {{(pid=122216) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Oct 29 13:41:33.532340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8454beb-9a8e-46c2-838c-2f35682e24a9',volume_size=None,volume_type=None)] {{(pid=122216) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Oct 29 13:41:33.651670 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5dcc0d1b-6163-4d42-a61a-82396a5ce2be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.673369 Oct 29 13:41:33.652297 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 562/1148] 10.222.0.96 () {60 vars in 1146 bytes} [Fri Oct 29 13:41:32 2021] POST /compute/v2.1/servers => generated 405 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 29 13:41:33.662353 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-921802de-227f-4f5f-94a3-606672737b74 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:33.663111 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-921802de-227f-4f5f-94a3-606672737b74 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:33.713304 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-921802de-227f-4f5f-94a3-606672737b74 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:33.719967 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-921802de-227f-4f5f-94a3-606672737b74 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1092 microversion: 2.1 time: 0.061341 Oct 29 13:41:33.720521 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 587/1149] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:33 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1092 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:34.736367 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:34.736983 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:34.742861 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:34.743966 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:34.744742 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:34.745178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:34.811818 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:34.820600 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-0e5986e6-2368-4138-b6a7-4cd53b4d7cc6 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1208 microversion: 2.1 time: 0.087812 Oct 29 13:41:34.821118 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 563/1150] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:34 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1208 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:35.819373 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-8f202b65-895f-4bf2-98ff-a2ffba238eac req-7f6ab929-ab14-403b-8f4f-107e744c1e9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643d3cf3-9b7c-4013-ac8e-60433989d1a9", "tag": "ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:41:35.821050 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:41:35.821050 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:41:35.829067 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-8f202b65-895f-4bf2-98ff-a2ffba238eac req-7f6ab929-ab14-403b-8f4f-107e744c1e9a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:35.829506 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-8f202b65-895f-4bf2-98ff-a2ffba238eac req-7f6ab929-ab14-403b-8f4f-107e744c1e9a service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:35.838677 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:35.840161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:35.842996 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-8f202b65-895f-4bf2-98ff-a2ffba238eac req-7f6ab929-ab14-403b-8f4f-107e744c1e9a service nova] Creating event network-changed:ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0 for instance 643d3cf3-9b7c-4013-ac8e-60433989d1a9 on hv-cinder-81588 Oct 29 13:41:35.848217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-8f202b65-895f-4bf2-98ff-a2ffba238eac req-7f6ab929-ab14-403b-8f4f-107e744c1e9a service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032814 Oct 29 13:41:35.848962 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:35.849334 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 588/1151] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:41:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:41:35.849943 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:35.850792 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:35.851466 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:36.062356 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:36.069578 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e4965fe9-4af6-44e5-9acd-5a0748c0b150 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.235938 Oct 29 13:41:36.070325 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 564/1152] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:35 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:37.087893 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:37.088618 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:37.094624 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:37.095073 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:37.095833 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:37.096265 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:37.215935 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:37.223085 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d87b634a-d0d3-49eb-9c05-a7785b54860d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.139852 Oct 29 13:41:37.223641 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 589/1153] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:37 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:41:38.240069 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:38.240676 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:38.246534 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:38.246979 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:38.247737 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:38.248165 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:38.365491 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:38.372582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-e4f50621-fdec-45f7-9993-7d447897d61b tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.136171 Oct 29 13:41:38.373149 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 565/1154] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:38 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:39.389206 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:39.389831 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:39.395689 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:39.396134 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:39.396893 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:39.397321 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:39.513395 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:39.520512 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cf150524-877d-45da-9f97-e9c96b931d84 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.134926 Oct 29 13:41:39.521075 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 590/1155] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:39 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:40.536142 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:40.536745 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:40.542542 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:40.542985 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:40.543736 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:40.544163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:40.664161 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:40.671380 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-aa4fba11-9322-4f1c-b7fc-3719631d8839 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.138919 Oct 29 13:41:40.671933 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 566/1156] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:40 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:41.687740 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:41.688371 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:41.694173 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:41.694610 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:41.695359 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:41.695784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:41.811427 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:41.818494 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-b8709545-7720-4a46-b6a1-518deb5e262f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.134373 Oct 29 13:41:41.819048 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 591/1157] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:41 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:42.835412 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:42.836022 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:42.842271 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:42.842720 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:42.843517 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:42.844329 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:42.961506 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:42.969470 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-dd5c090e-877f-458e-a1c1-19c28a5a5c12 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.137745 Oct 29 13:41:42.970067 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 567/1158] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:42 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:43.986072 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:43.986683 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:43.992558 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:43.993004 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:43.993764 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:43.994219 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:44.121222 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:44.128583 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-07984c14-3e2d-469d-93c4-928b8a703c34 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.146215 Oct 29 13:41:44.129147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 592/1159] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:43 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:45.145340 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:45.146055 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:45.152449 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:45.152895 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:45.153661 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:45.154122 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:45.270140 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:45.278090 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9dfca6ab-27c3-45db-bfd3-aef567d93cb4 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.136380 Oct 29 13:41:45.278663 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 568/1160] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:45 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:46.295153 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:46.295711 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:46.301539 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:46.302015 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:46.302775 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:46.303201 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:46.421540 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:46.428772 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-1fdbc978-4992-4b27-972b-c09cc63983ff tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.137341 Oct 29 13:41:46.429325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 593/1161] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:46 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:46.497551 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-64b9f8f3-eaf0-48e3-a89d-f8fbc8243402 req-3e3f8adf-1d5c-4add-8a88-ffa523484f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643d3cf3-9b7c-4013-ac8e-60433989d1a9", "name": "network-vif-plugged", "status": "completed", "tag": "ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:41:46.499060 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:41:46.499060 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:41:46.506352 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-64b9f8f3-eaf0-48e3-a89d-f8fbc8243402 req-3e3f8adf-1d5c-4add-8a88-ffa523484f2c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:46.506782 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-64b9f8f3-eaf0-48e3-a89d-f8fbc8243402 req-3e3f8adf-1d5c-4add-8a88-ffa523484f2c service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:46.517495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-64b9f8f3-eaf0-48e3-a89d-f8fbc8243402 req-3e3f8adf-1d5c-4add-8a88-ffa523484f2c service nova] Creating event network-vif-plugged:ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0 for instance 643d3cf3-9b7c-4013-ac8e-60433989d1a9 on hv-cinder-81588 Oct 29 13:41:46.522495 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-64b9f8f3-eaf0-48e3-a89d-f8fbc8243402 req-3e3f8adf-1d5c-4add-8a88-ffa523484f2c service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028591 Oct 29 13:41:46.523146 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 569/1162] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:41:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:41:47.445596 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:47.446767 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:47.452549 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:47.453015 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:47.453786 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:47.454217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:47.572952 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:47.580228 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cbb9fa4b-ec0b-47bf-bf60-57c25e0c4027 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1263 microversion: 2.1 time: 0.138324 Oct 29 13:41:47.580774 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 594/1163] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:47 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1263 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:48.596758 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:48.597485 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:48.603588 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:48.604028 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:48.604814 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:48.605243 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:48.722383 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:48.730141 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a7d66080-bd7b-4b29-983a-76e209ff75a8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1450 microversion: 2.1 time: 0.137338 Oct 29 13:41:48.730711 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 570/1164] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:48 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1450 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:48.746202 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:41:48.746800 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:41:48.752784 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:48.753221 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:48.754002 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:48.754426 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:48.873250 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:41:48.880624 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-95accd6c-d3ea-4c62-ada4-f3d2c527becf tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1450 microversion: 2.1 time: 0.138070 Oct 29 13:41:48.881190 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 595/1165] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:41:48 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1450 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:41:50.417693 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-2752add0-fb34-4105-b0b7-77c6733008c3 req-23a004ca-e510-43b3-906a-4f52c5dbd997 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643d3cf3-9b7c-4013-ac8e-60433989d1a9", "tag": "ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:41:50.419479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:41:50.419479 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:41:50.426588 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2752add0-fb34-4105-b0b7-77c6733008c3 req-23a004ca-e510-43b3-906a-4f52c5dbd997 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:41:50.427110 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-2752add0-fb34-4105-b0b7-77c6733008c3 req-23a004ca-e510-43b3-906a-4f52c5dbd997 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:41:50.437703 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-2752add0-fb34-4105-b0b7-77c6733008c3 req-23a004ca-e510-43b3-906a-4f52c5dbd997 service nova] Creating event network-changed:ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0 for instance 643d3cf3-9b7c-4013-ac8e-60433989d1a9 on hv-cinder-81588 Oct 29 13:41:50.442548 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-2752add0-fb34-4105-b0b7-77c6733008c3 req-23a004ca-e510-43b3-906a-4f52c5dbd997 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029301 Oct 29 13:41:50.443121 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 571/1166] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:41:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:42:25.541688 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:42:25.542241 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:42:25.545240 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-29e7e1e5-9569-4f38-9e56-211cd49359ad req-5f6c5c4e-2fc9-4161-9b1a-edcaece291cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1", "tag": "1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:42:25.546768 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:42:25.546768 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:42:25.548313 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:25.548763 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:25.549531 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:25.550007 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:25.554178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-29e7e1e5-9569-4f38-9e56-211cd49359ad req-5f6c5c4e-2fc9-4161-9b1a-edcaece291cc service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:25.554619 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-29e7e1e5-9569-4f38-9e56-211cd49359ad req-5f6c5c4e-2fc9-4161-9b1a-edcaece291cc service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:25.566747 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-29e7e1e5-9569-4f38-9e56-211cd49359ad req-5f6c5c4e-2fc9-4161-9b1a-edcaece291cc service nova] Creating event network-changed:1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2 for instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 on hv-cinder-81588 Oct 29 13:42:25.571975 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-29e7e1e5-9569-4f38-9e56-211cd49359ad req-5f6c5c4e-2fc9-4161-9b1a-edcaece291cc service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030929 Oct 29 13:42:25.572921 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 572/1167] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:42:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:42:25.576179 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:42:25.673662 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-7fef0e00-6776-4af9-9db5-e4a715912e22 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "DELETE /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 204 len: 0 microversion: 2.1 time: 0.135845 Oct 29 13:42:25.675953 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 596/1168] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:42:25 2021] DELETE /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:42:25.685211 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:42:25.690746 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:42:25.692309 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:25.692764 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:25.693553 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:25.694178 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:26.025204 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:42:26.032683 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-a3a81442-46e7-4b43-8b32-dccecfc536aa tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1567 microversion: 2.1 time: 0.352320 Oct 29 13:42:26.033249 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 573/1169] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:42:25 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:42:27.050477 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:42:27.051099 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:42:27.057364 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:27.057838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:27.058604 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:27.059041 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:27.119124 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:42:27.119350 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: Fri Oct 29 13:42:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 (ip 10.222.0.96) !!! Oct 29 13:42:27.225270 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:42:27.232955 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-540d1702-fb1f-4d08-9306-33185a518ba1 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1448 microversion: 2.1 time: 0.186572 Oct 29 13:42:27.233519 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 597/1170] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:42:27 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1448 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:42:27.713901 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-9c2521a3-cc91-40bd-b80d-143fc61848d6 req-f91ef851-2a78-4645-ad24-08424e6339bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1", "name": "network-vif-deleted", "tag": "1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:42:27.715582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:42:27.715582 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:42:27.722806 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-9c2521a3-cc91-40bd-b80d-143fc61848d6 req-f91ef851-2a78-4645-ad24-08424e6339bd service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:27.723246 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-9c2521a3-cc91-40bd-b80d-143fc61848d6 req-f91ef851-2a78-4645-ad24-08424e6339bd service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:27.735314 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-9c2521a3-cc91-40bd-b80d-143fc61848d6 req-f91ef851-2a78-4645-ad24-08424e6339bd service nova] Creating event network-vif-deleted:1bf5e6ee-bf40-46cf-9f3e-cdf8cb675bc2 for instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 on hv-cinder-81588 Oct 29 13:42:27.740181 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-9c2521a3-cc91-40bd-b80d-143fc61848d6 req-f91ef851-2a78-4645-ad24-08424e6339bd service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030656 Oct 29 13:42:27.740766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 574/1171] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:42:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 29 13:42:28.250103 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:42:28.250712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:42:28.256628 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:28.257584 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:28.258376 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:28.258809 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:28.287807 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:28.288262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:28.288712 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lazy-loading 'fault' on Instance uuid ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:42:28.328344 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e9366dec6d04ecdb0574a2d2e812a51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01041e00f28e4197a613ed2b47866c73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:42:28.336269 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d33f0a05-cc7a-4a81-8841-75ae83c71eea tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 200 len: 1223 microversion: 2.1 time: 0.089771 Oct 29 13:42:28.336842 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 598/1172] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:42:28 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:42:29.353335 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:42:29.354085 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] [instance: ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:42:29.360011 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:29.360459 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:29.361224 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:42:29.361656 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:42:29.374293 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] HTTP exception thrown: Instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 could not be found. Oct 29 13:42:29.374872 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Returning 404 to user: Instance ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:42:29.375678 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-3327af9e-b2d3-463c-915f-d2e593f271e4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1" status: 404 len: 111 microversion: 2.1 time: 0.027022 Oct 29 13:42:29.376452 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 575/1173] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:42:29 2021] GET /compute/v2.1/servers/ab6ff5a7-093b-4b8c-ba6d-ea0807910bf1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:42:29.531082 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-d4a340a2-521f-4f50-9c7b-b4f77864bba4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] Calling method '.version_select at 0x7f548002fee0>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:42:29.551657 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-d4a340a2-521f-4f50-9c7b-b4f77864bba4 tempest-TestShelveInstance-963188695 tempest-TestShelveInstance-963188695-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-383892962" status: 202 len: 0 microversion: 2.1 time: 0.024203 Oct 29 13:42:29.552575 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 599/1174] 10.222.0.96 () {58 vars in 1250 bytes} [Fri Oct 29 13:42:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-383892962 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 29 13:43:19.588075 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ee986980-28fe-4937-9232-4ce5056cf12d] AMQP server on 10.222.0.96:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 29 13:43:19.591965 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:19.592461 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:19.599456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:19.600183 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:19.601870 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:19.602552 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:19.628322 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Going to try to terminate instance {{(pid=122216) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:43:19.711960 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-b05e0d2f-97d8-4a13-9d3e-088cd389a45f tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "DELETE /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 204 len: 0 microversion: 2.1 time: 0.124975 Oct 29 13:43:19.712456 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 576/1175] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:43:19 2021] DELETE /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:43:19.720577 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:19.721278 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:19.727145 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:19.727661 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:19.728500 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:19.728999 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:19.783040 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [req-9cc8a2e9-5b21-41bf-af79-24937d7549e5 req-75122e6f-9247-42dd-bf9d-c7730122b031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "643d3cf3-9b7c-4013-ac8e-60433989d1a9", "tag": "ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0"}]} {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:43:19.784583 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:43:19.784583 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: warnings.warn(msg) Oct 29 13:43:19.791654 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-9cc8a2e9-5b21-41bf-af79-24937d7549e5 req-75122e6f-9247-42dd-bf9d-c7730122b031 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:19.792093 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [req-9cc8a2e9-5b21-41bf-af79-24937d7549e5 req-75122e6f-9247-42dd-bf9d-c7730122b031 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:19.805148 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.compute.server_external_events [req-9cc8a2e9-5b21-41bf-af79-24937d7549e5 req-75122e6f-9247-42dd-bf9d-c7730122b031 service nova] Creating event network-changed:ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0 for instance 643d3cf3-9b7c-4013-ac8e-60433989d1a9 on hv-cinder-81588 Oct 29 13:43:19.810333 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [req-9cc8a2e9-5b21-41bf-af79-24937d7549e5 req-75122e6f-9247-42dd-bf9d-c7730122b031 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220755 Oct 29 13:43:19.811756 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 600/1176] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:43:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:43:19.858875 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:43:19.866408 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-fde57487-39fd-44cb-a329-fe8538602384 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1575 microversion: 2.1 time: 0.149634 Oct 29 13:43:19.867165 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 577/1177] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:19 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 29 13:43:20.885490 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:20.886209 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:20.892225 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:20.892664 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:20.893415 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:20.893932 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:21.013083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:43:21.020294 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-450cdb99-bce7-4bfd-8383-68d69292c460 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1456 microversion: 2.1 time: 0.140147 Oct 29 13:43:21.020838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 601/1178] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:20 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1456 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:43:21.826749 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-b139e123-a723-40f9-9363-7aa02511c69b req-13dd6c98-3ada-4598-be58-13ddc7514d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "643d3cf3-9b7c-4013-ac8e-60433989d1a9", "name": "network-vif-deleted", "tag": "ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:43:21.828220 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:43:21.828220 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:43:21.845087 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-b139e123-a723-40f9-9363-7aa02511c69b req-13dd6c98-3ada-4598-be58-13ddc7514d8e service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:21.845532 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-b139e123-a723-40f9-9363-7aa02511c69b req-13dd6c98-3ada-4598-be58-13ddc7514d8e service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:21.856186 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] [ee986980-28fe-4937-9232-4ce5056cf12d] Reconnected to AMQP server on 10.222.0.96:5672 via [amqp] client with port 38376. Oct 29 13:43:21.857980 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-b139e123-a723-40f9-9363-7aa02511c69b req-13dd6c98-3ada-4598-be58-13ddc7514d8e service nova] Creating event network-vif-deleted:ab2e1ae8-7fd2-4e82-a607-d752dc8f16d0 for instance 643d3cf3-9b7c-4013-ac8e-60433989d1a9 on hv-cinder-81588 Oct 29 13:43:21.862399 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-b139e123-a723-40f9-9363-7aa02511c69b req-13dd6c98-3ada-4598-be58-13ddc7514d8e service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039271 Oct 29 13:43:21.863078 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 578/1179] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:43:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:43:22.036218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:22.036805 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:22.043264 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:22.043705 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:22.044471 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:22.044898 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:22.076984 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:22.077431 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:22.078130 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.objects.instance [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lazy-loading 'fault' on Instance uuid 643d3cf3-9b7c-4013-ac8e-60433989d1a9 {{(pid=122215) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Oct 29 13:43:22.121911 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:43:22.129646 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-3e6e4e5b-da90-44a7-b8d8-74073907b0be tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 200 len: 1228 microversion: 2.1 time: 0.097153 Oct 29 13:43:22.130262 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 602/1180] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:22 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 1228 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:43:23.149137 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:23.149890 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: 643d3cf3-9b7c-4013-ac8e-60433989d1a9] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:23.155882 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:23.156329 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:23.157418 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:23.157886 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:23.171576 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] HTTP exception thrown: Instance 643d3cf3-9b7c-4013-ac8e-60433989d1a9 could not be found. Oct 29 13:43:23.172163 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Returning 404 to user: Instance 643d3cf3-9b7c-4013-ac8e-60433989d1a9 could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:43:23.172991 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-9103b50c-9d2b-4ec2-8ee5-a81172ef5203 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9" status: 404 len: 111 microversion: 2.1 time: 0.028540 Oct 29 13:43:23.173650 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 579/1181] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:23 2021] GET /compute/v2.1/servers/643d3cf3-9b7c-4013-ac8e-60433989d1a9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 29 13:43:26.436965 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:26.437466 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:26.439540 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-02591846-fe5a-48fa-83f4-c91065902b28 req-30a1f2ed-2e3e-4676-bec5-d5e648cdd7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7753d2e-eb91-4518-a32a-9c3b4ec957b0", "tag": "c8f3ee5d-4cf0-44ec-9150-c8bf02913da9"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:43:26.440998 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:43:26.440998 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:43:26.443552 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:26.444001 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:26.444777 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:26.445211 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:26.448493 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-02591846-fe5a-48fa-83f4-c91065902b28 req-30a1f2ed-2e3e-4676-bec5-d5e648cdd7e7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:26.449160 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-02591846-fe5a-48fa-83f4-c91065902b28 req-30a1f2ed-2e3e-4676-bec5-d5e648cdd7e7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:26.460267 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-02591846-fe5a-48fa-83f4-c91065902b28 req-30a1f2ed-2e3e-4676-bec5-d5e648cdd7e7 service nova] Creating event network-changed:c8f3ee5d-4cf0-44ec-9150-c8bf02913da9 for instance e7753d2e-eb91-4518-a32a-9c3b4ec957b0 on hv-cinder-81588 Oct 29 13:43:26.465454 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-02591846-fe5a-48fa-83f4-c91065902b28 req-30a1f2ed-2e3e-4676-bec5-d5e648cdd7e7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029387 Oct 29 13:43:26.466401 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 580/1182] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:43:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:43:26.471083 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Going to try to terminate instance {{(pid=122215) delete /opt/stack/nova/nova/compute/api.py:2612}} Oct 29 13:43:26.558548 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-cca4cea1-4a6a-4880-8b5e-520af7a3eafd tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "DELETE /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 204 len: 0 microversion: 2.1 time: 0.124906 Oct 29 13:43:26.561870 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 603/1183] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:43:26 2021] DELETE /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 29 13:43:26.567896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:26.568856 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:26.575201 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:26.575896 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:26.576888 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:26.577594 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:26.773019 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.policy [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122216) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:43:26.782662 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-5d44fa3d-8763-4d5c-9c14-20ce12605df8 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1576 microversion: 2.1 time: 0.218780 Oct 29 13:43:26.783905 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 581/1184] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:26 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1576 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:43:27.801502 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:27.802145 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:27.808305 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:27.808742 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:27.809488 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:27.809942 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:28.149461 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.policy [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c8d9c5df1a447ea666d48b3a35ec96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dda9cf39e3ff4797af5227f990f14457', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122215) authorize /opt/stack/nova/nova/policy.py:199}} Oct 29 13:43:28.156808 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-e8b503f2-4448-41de-90e1-0bc3e653d747 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 200 len: 1457 microversion: 2.1 time: 0.359655 Oct 29 13:43:28.157369 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 604/1185] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:27 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 1457 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 29 13:43:28.538563 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [req-089f3783-7a61-452a-90fb-ea4f8419b276 req-0656a904-c52c-47ac-8dc1-632949c3a9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7753d2e-eb91-4518-a32a-9c3b4ec957b0", "name": "network-vif-deleted", "tag": "c8f3ee5d-4cf0-44ec-9150-c8bf02913da9"}]} {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 29 13:43:28.540716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 13:43:28.540716 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: warnings.warn(msg) Oct 29 13:43:28.547637 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-089f3783-7a61-452a-90fb-ea4f8419b276 req-0656a904-c52c-47ac-8dc1-632949c3a9c7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:28.548080 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [req-089f3783-7a61-452a-90fb-ea4f8419b276 req-0656a904-c52c-47ac-8dc1-632949c3a9c7 service nova] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:28.560298 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.compute.server_external_events [req-089f3783-7a61-452a-90fb-ea4f8419b276 req-0656a904-c52c-47ac-8dc1-632949c3a9c7 service nova] Creating event network-vif-deleted:c8f3ee5d-4cf0-44ec-9150-c8bf02913da9 for instance e7753d2e-eb91-4518-a32a-9c3b4ec957b0 on hv-cinder-81588 Oct 29 13:43:28.565008 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [req-089f3783-7a61-452a-90fb-ea4f8419b276 req-0656a904-c52c-47ac-8dc1-632949c3a9c7 service nova] 10.222.0.96 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030093 Oct 29 13:43:28.565638 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 582/1186] 10.222.0.96 () {64 vars in 1317 bytes} [Fri Oct 29 13:43:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 29 13:43:29.174218 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:29.174827 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e7753d2e-eb91-4518-a32a-9c3b4ec957b0] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:29.182963 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:29.183435 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:29.184201 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:29.184625 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:29.198306 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] HTTP exception thrown: Instance e7753d2e-eb91-4518-a32a-9c3b4ec957b0 could not be found. Oct 29 13:43:29.198883 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Returning 404 to user: Instance e7753d2e-eb91-4518-a32a-9c3b4ec957b0 could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:43:29.199705 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-9fca2244-465c-428d-b675-e74e04fd4260 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0" status: 404 len: 111 microversion: 2.1 time: 0.029364 Oct 29 13:43:29.200217 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 605/1187] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:29 2021] GET /compute/v2.1/servers/e7753d2e-eb91-4518-a32a-9c3b4ec957b0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:43:29.639022 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:29.639623 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.compute.api [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122216) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:29.645498 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:29.646006 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:29.646766 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:29.647196 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG oslo_concurrency.lockutils [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122216) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:29.659860 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.wsgi [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] HTTP exception thrown: Instance e312109a-5d7f-40b7-a0f4-c652d210410a could not be found. Oct 29 13:43:29.660433 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Returning 404 to user: Instance e312109a-5d7f-40b7-a0f4-c652d210410a could not be found. {{(pid=122216) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:43:29.661229 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-79c08b67-2caa-44ea-a751-5a245c980b9d tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "DELETE /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 404 len: 111 microversion: 2.1 time: 0.026319 Oct 29 13:43:29.661741 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 583/1188] 10.222.0.96 () {58 vars in 1238 bytes} [Fri Oct 29 13:43:29 2021] DELETE /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:43:29.669938 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '>' {{(pid=122215) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:29.670636 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.compute.api [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] [instance: e312109a-5d7f-40b7-a0f4-c652d210410a] Fetching instance by UUID {{(pid=122215) get /opt/stack/nova/nova/compute/api.py:2863}} Oct 29 13:43:29.676296 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:29.676728 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:29.677480 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Oct 29 13:43:29.677946 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG oslo_concurrency.lockutils [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Lock "0fd04116-658c-4f9b-9b80-4c1c1d069e0f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122215) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Oct 29 13:43:29.691258 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.wsgi [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] HTTP exception thrown: Instance e312109a-5d7f-40b7-a0f4-c652d210410a could not be found. Oct 29 13:43:29.691838 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: DEBUG nova.api.openstack.wsgi [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Returning 404 to user: Instance e312109a-5d7f-40b7-a0f4-c652d210410a could not be found. {{(pid=122215) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Oct 29 13:43:29.692653 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO nova.api.openstack.requestlog [None req-504a4a31-d909-401a-afd4-4735b1c02d73 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a" status: 404 len: 111 microversion: 2.1 time: 0.026335 Oct 29 13:43:29.693147 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: [pid: 122215|app: 0|req: 606/1189] 10.222.0.96 () {58 vars in 1235 bytes} [Fri Oct 29 13:43:29 2021] GET /compute/v2.1/servers/e312109a-5d7f-40b7-a0f4-c652d210410a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 29 13:43:30.970508 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: DEBUG nova.api.openstack.wsgi [None req-f0870e5e-2b38-4ffe-a516-91693734e255 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] Calling method '.version_select at 0x7f547c136430>' {{(pid=122216) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 29 13:43:30.990846 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO nova.api.openstack.requestlog [None req-f0870e5e-2b38-4ffe-a516-91693734e255 tempest-TestVolumeBootPattern-471298346 tempest-TestVolumeBootPattern-471298346-project] 10.222.0.96 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-36819492" status: 202 len: 0 microversion: 2.1 time: 0.023860 Oct 29 13:43:30.991618 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: [pid: 122216|app: 0|req: 584/1190] 10.222.0.96 () {58 vars in 1256 bytes} [Fri Oct 29 13:43:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-36819492 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 29 13:44:05.025781 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:44:05.026446 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: Fri Oct 29 13:44:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:45:47.137696 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:45:47.138325 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: Fri Oct 29 13:45:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:45:59.293400 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:45:59.293992 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: Fri Oct 29 13:45:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:46:00.506747 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:46:00.507269 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: Fri Oct 29 13:46:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:46:07.417946 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:46:07.418635 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: Fri Oct 29 13:46:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:47:25.042585 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:47:25.043148 dv-cinder-815884-1-iscsi devstack@n-api.service[122216]: Fri Oct 29 13:47:25 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Oct 29 13:47:47.388806 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 29 13:47:47.389409 dv-cinder-815884-1-iscsi devstack@n-api.service[122215]: Fri Oct 29 13:47:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!